-- Logs begin at Wed 2022-08-24 02:44:23 UTC, end at Wed 2022-08-24 03:54:34 UTC. -- Aug 24 03:17:26.031221 dv-cinder-854260-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 03:17:26.043447 dv-cinder-854260-1-smb devstack@keystone.service[81522]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:17:26 2022] *** Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: nodename: dv-cinder-854260-1-smb Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: machine: x86_64 Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: clock source: unix Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: pcre jit disabled Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: detected number of CPU cores: 4 Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: current working directory: / Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: your processes number limit is 47680 Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: your memory page size is 4096 bytes Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: detected max file descriptor number: 2048 Aug 24 03:17:26.048121 dv-cinder-854260-1-smb devstack@keystone.service[81522]: lock engine: pthread robust mutexes Aug 24 03:17:26.049550 dv-cinder-854260-1-smb devstack@keystone.service[81522]: thunder lock: enabled Aug 24 03:17:26.049550 dv-cinder-854260-1-smb devstack@keystone.service[81522]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 03:17:26.049550 dv-cinder-854260-1-smb devstack@keystone.service[81522]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:17:26.095867 dv-cinder-854260-1-smb devstack@keystone.service[81522]: Python main interpreter initialized at 0x557efb2a99c0 Aug 24 03:17:26.095867 dv-cinder-854260-1-smb devstack@keystone.service[81522]: python threads support enabled Aug 24 03:17:26.095867 dv-cinder-854260-1-smb devstack@keystone.service[81522]: your server socket listen backlog is limited to 100 connections Aug 24 03:17:26.095867 dv-cinder-854260-1-smb devstack@keystone.service[81522]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:17:26.096416 dv-cinder-854260-1-smb devstack@keystone.service[81522]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:17:26.096416 dv-cinder-854260-1-smb devstack@keystone.service[81522]: *** Operational MODE: preforking *** Aug 24 03:17:26.096849 dv-cinder-854260-1-smb devstack@keystone.service[81522]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:17:26.096849 dv-cinder-854260-1-smb devstack@keystone.service[81522]: spawned uWSGI master process (pid: 81522) Aug 24 03:17:26.097127 dv-cinder-854260-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 03:17:26.101576 dv-cinder-854260-1-smb devstack@keystone.service[81522]: spawned uWSGI worker 1 (pid: 81534, cores: 1) Aug 24 03:17:26.101576 dv-cinder-854260-1-smb devstack@keystone.service[81522]: spawned uWSGI worker 2 (pid: 81535, cores: 1) Aug 24 03:17:26.101576 dv-cinder-854260-1-smb devstack@keystone.service[81522]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:17:30.569415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:17:30.569415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: from cryptography.utils import int_from_bytes Aug 24 03:17:30.570375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:17:30.570375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: from cryptography.utils import int_from_bytes Aug 24 03:17:30.615231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:17:30.615231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: from cryptography.utils import int_from_bytes Aug 24 03:17:30.615802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:17:30.615802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: from cryptography.utils import int_from_bytes Aug 24 03:17:30.623496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:17:30.623707 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:17:30.623908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] command line args: [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:17:30.624205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:17:30.624402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ================================================================================ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:17:30.624669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] admin_token = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.624925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] config_dir = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.625136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.625333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] config_source = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.625530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] debug = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.625772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.627433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.627433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.627433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.627433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.627433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.627433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_config_append = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.627920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.627920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_dir = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.627920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_file = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.628116 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.628389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.628622 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.628928 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.629219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.629333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.629548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.629824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.630085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.630346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.630608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.630875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.631139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.631469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.631756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.633553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.633553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] publish_errors = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.633553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.633553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.633553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.633553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.634191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.634191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] standard_threads = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.634367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.635100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.635100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.635100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_journal = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.635100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_json = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.635876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_stderr = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.635876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_syslog = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.635876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.636165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.636259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.636484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.636753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.637035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.637035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.637035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.637035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.638348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.638348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.638537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.638751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.639029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.639273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.639548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.639821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.640125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.640367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.640648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.640920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.641172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.641455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.641746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.642021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.642295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.642535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.642843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.643108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.643366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.643640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.643893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.644129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.644365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.644616 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.644868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.645120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.645369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.645606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.645846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.646086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.646323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.646559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.646816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.647088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.647482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.647747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.647984 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.648228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.648463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.648702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.648942 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.649192 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.649427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.649669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.649910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.650215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.650411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.650698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.650939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.651223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.651465 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.651727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.651982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.652264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.652525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.652785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.653053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.653299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.653591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.653869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.654138 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.654428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.654705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.654954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.655215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.655501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.655761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.656024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.656296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.656546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.656881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.657121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.657362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.657611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.657888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.658156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.658418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.658695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.658969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.659242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.659482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.659741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.659975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.660231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.660485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.660726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.660963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.661209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.661467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.661744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.662007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.662276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.662976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.662976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.663307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.external = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.663442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.663731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.663963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.664213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.password = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.664448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.token = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.664688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.664930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.665207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.665466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.665717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.665970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.666220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.666482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.666780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.667054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.667317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.667584 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.667855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.668163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.668390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.668667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.668932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:17:30.669124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.669270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:17:30.669403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.669653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] command line args: [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:17:30.669789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.669928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:17:30.670060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.670194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ================================================================================ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:17:30.670323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.670578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] admin_token = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.670735 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.670868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] config_dir = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.670997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.671136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.671136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] config_source = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.671399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.671525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] debug = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.671665 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.671793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.671955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.672086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.672207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.672327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.672449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.672577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.672718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.672863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.673001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.673141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.673141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_config_append = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.673383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.673518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.673664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.673801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_dir = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.673801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.674135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.674275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.674461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.674624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.674855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.675009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.675176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.675347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.675533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.675705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.675891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.676021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.676154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.676299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.676455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.676612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.676744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.676894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.677028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.677352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.677490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.677634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.677751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.677948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.678083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.678609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.678706 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.678834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.678960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.679047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.679109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.679109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.679416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.679513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.679653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] publish_errors = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.679792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.679875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.680010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.680144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.680144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.680459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.680554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.680674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.680762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.680825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.680884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] standard_threads = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.680955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.680955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.680955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.681225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.681307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.681381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.681453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.681536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.681614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.681695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_journal = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.681770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.681899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_json = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.682037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.682167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_stderr = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.682298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.682443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_syslog = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.682443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:17:30.682685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.682765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.682827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.682916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683014 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.683905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.684862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.685005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.685122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.685200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.685316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.685421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.685511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.685614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.685739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.685878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686608 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.686908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.687019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.687147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.687277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.687403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.687403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.687647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.687753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.687825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.687952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.688084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.688084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.688291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.688291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.688535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.688667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.688799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.688949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.689089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.689240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.689367 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.689494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.689625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.689756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.689888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.690030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.690030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.690288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.690427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.690570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.690725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.690882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.691017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.691144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.691272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.691405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.691539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.691686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.691830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.691962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.692102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.692247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.692380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.692527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.692659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.692793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.692926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.693057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.693195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.693349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.693484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.693615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.693873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.694020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.694156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.694377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.694514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.694646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.694898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.695029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.695180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.695277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.695370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.695501 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.695636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.695636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.695894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.696010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.696138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.696277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.696420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.696551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.696698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.696833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.696967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.697101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.697233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.697347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.697492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.697626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.697755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.698242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.698375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.698509 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.698789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.698928 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.699060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.699192 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.699192 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.699430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.699576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] role.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.699719 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.699852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] role.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.699986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.700111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.700238 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.700385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.700521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.700664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.700795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.700926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.701058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.701207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.701340 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.701471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.701616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.701751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.701874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.702022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.702156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.702290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.702420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.702553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.702783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.702936 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.703071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.703217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.703352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.703487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.703621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.703768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.703903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.703903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.704154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.704289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.704422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.704567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.704713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.704846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.704976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.705107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.705238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.705385 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.705517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.705644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.705780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.705916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.705916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.706179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.706310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.706441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.706573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.706724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.706856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.707003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.707136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.707267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.707399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.707528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.707660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.707801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.707932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.708060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.708189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.708317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.708460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.708604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.708736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.708865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.708993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.709125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.709275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.709407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.709539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.709631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.709731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.709816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.709925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.710028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.710126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.710217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.710314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.external = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.710408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.710514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.710600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.710793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.710904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.password = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.token = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.711921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.712024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.712127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.712230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.712334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.712448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.712554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.712554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.712774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.712904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.713840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714116 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714526 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.714945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.715159 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.715159 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.715355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.715471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.715608 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.715749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.715879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.716011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.716142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.716272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.716400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.716522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.716522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.716784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.716913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.717036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.717119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:17:30.717193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.717193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.717415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.717597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.717798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.718174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.718437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.718711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.718962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.719287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.719597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.719847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.720104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.720356 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.720593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.720831 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.721082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.721314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.721626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.721943 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.722205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.722486 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.722777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.722980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.723187 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.723386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.723759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.723954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.724274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.724558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.724832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.725591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.726015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.726324 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.726565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.727136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.727136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.727532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.727718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.727931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.728173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.728423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.728663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.728915 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.729161 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.729391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.729631 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.729861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.730100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.730340 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.730599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.730888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.731082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.731348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.731597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.731832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.732066 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.732316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.732565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.732802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.733041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.733276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.733508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.733887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.734147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.734386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.734632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.734887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.735146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.735388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.735620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.735839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.736079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.736317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.736548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.737064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.737315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.737739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.738078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.738331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.738536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.738854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.739102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.739337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.739607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.739844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.740093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.740342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.740583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.740893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.741296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.741742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.742015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.742254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.742495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.742771 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.743018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.743252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.743490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.743733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.743985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.744238 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.744478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.744728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.744982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.745218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.745641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.746008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.746255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.746495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] role.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.746891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] role.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.747139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.747531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.747825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.748170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.748420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.748606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.748792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.748931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.749082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.749212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.749344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.749520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.749757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.750013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.750257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.750508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.750907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.751367 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.751734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.751984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.752359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.752813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.752898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.753113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.753380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.753634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.754010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.754247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.754607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.754993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.755252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.755510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.755762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.756005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.756368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.756671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.757096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.757547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.757837 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.758084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.758348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.758644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.758848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.759007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.759141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.759503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.759755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.760040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.760253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.760492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.760742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.760993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.761222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.761469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.761781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.762169 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.762417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.762725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.762967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.763209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.763452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.763826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.764064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.764387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.764662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.764917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.765166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.765405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.765692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.765888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.766144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.766375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.766644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.766921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:17:30.767093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:17:30.790541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.790798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.800419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.800693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.800975 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.810682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.831845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.832109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.850023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.873846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.903113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.903472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.915421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.915743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.981748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.982108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.982201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.982386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.982611 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:30.982856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.013087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.013351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.013655 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.013878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.014122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.014338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.014595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.030440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.076053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.076340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.076476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.076685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.076908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.077134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.092652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.092875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.092987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.093245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.093490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.093709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.093954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.104043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.116709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.116937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.117115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.117334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.117578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.117802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.118039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.137405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.137626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:17:31.138004 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.138206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:17:31.138513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.138830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.139410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.139680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.150041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.150294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.150440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.150598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.150767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.150901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.150901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.151164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.151297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.151297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.151540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:17:31.158685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.162060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.162357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.162827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.163119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.163419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.163696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.163937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.164037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.164156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:17:31.164274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.164507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.164732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:17:31.164825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.165024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.165111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.165294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.165382 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.165587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.165858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.176820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.177119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.177400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.177706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.186077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.189573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.189804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.189980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.190168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.190530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.190896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.191166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.191334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.191426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.191676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.191838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.192020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.192288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.192698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.196792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.197103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.197427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.204487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.204893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.209645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.209959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.210275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.210583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.210896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.211179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.211456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.211736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.218193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.219792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.220083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.225322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.225802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.226294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.230638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.230960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.234134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.234448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.235189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.238624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.238958 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.239114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.239289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.239599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.240021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.240415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.241035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.241410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.241696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.243650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.246857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.250388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.250790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.251122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.251464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.251769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.252056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.259350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.259651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.263701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.267448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.267755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.269069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.269416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.269727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.270029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.273535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.276803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.277558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.279254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.279552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.280283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.280615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.280899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.281185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.281468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.282012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.282412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.282738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.283036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.283352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.283636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.296999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.297307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.297598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.297915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.298250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.298566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.298919 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.301141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.301443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.301722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.301991 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.310010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.313338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.313616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.316391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.316704 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.316853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.317046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.317337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.317747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.321117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.325442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.327262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.329262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.329546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.329852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.331817 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.332124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.332412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.332885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.333176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.333454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.333752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.337851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.339357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.342350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.342817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.343198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.343649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.351979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.354090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.354411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.354758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.355331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.358698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.360267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.361935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.362221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.362518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.362849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.363309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.363630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.363960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.364396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.364691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.364999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.365413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.365731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.366012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.366323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.366724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.367022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.367306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.370081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.371886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.374937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.375242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.375529 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.375816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.385109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.385417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.385708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.392782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:17:31.393313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.393612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.393890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.394238 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.394637 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.394940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.395214 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.395728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.396142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.396434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.396720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.397064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.397457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:17:31.407069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557efb2a99c0 pid: 81535 (default app) Aug 24 03:17:31.411350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c850f-0add-4046-81d9-2f4a1d0a9540 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:31.411704 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c850f-0add-4046-81d9-2f4a1d0a9540 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:31.411998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c850f-0add-4046-81d9-2f4a1d0a9540 None None] PATH_INFO: `/v3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:31.417730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 791 bytes} [Wed Aug 24 03:17:31 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:31.438097 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557efb2a99c0 pid: 81534 (default app) Aug 24 03:17:38.370015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f6c24-1f98-4be3-80c7-c74177effeae None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:38.370573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f6c24-1f98-4be3-80c7-c74177effeae None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:38.370573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f6c24-1f98-4be3-80c7-c74177effeae None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:38.372032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:17:38.386079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:38.386671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:38.386671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:38.461271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: INFO dbcounter [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] Registered counter for database keystone Aug 24 03:17:38.484470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG oslo_db.sqlalchemy.engines [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:17:38.491985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writer thread running {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:17:38.685673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG passlib.handlers.bcrypt [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81534) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:17:38.686095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG passlib.handlers.bcrypt [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81534) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:17:38.743841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:38.745488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:38.909609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1/3] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 03:17:39.414692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f6c24-1f98-4be3-80c7-c74177effeae None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:39.489160 dv-cinder-854260-1-smb devstack@keystone.service[81535]: INFO dbcounter [None req-028f6c24-1f98-4be3-80c7-c74177effeae None None] Registered counter for database keystone Aug 24 03:17:39.513232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG oslo_db.sqlalchemy.engines [None req-028f6c24-1f98-4be3-80c7-c74177effeae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:17:39.520336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writer thread running {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:17:39.643201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f6c24-1f98-4be3-80c7-c74177effeae None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:39.648002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a0ab6-3fd6-4b89-8289-15b2aaeb4110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:39.648652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0ab6-3fd6-4b89-8289-15b2aaeb4110 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:39.648929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0ab6-3fd6-4b89-8289-15b2aaeb4110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:39.649239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0ab6-3fd6-4b89-8289-15b2aaeb4110 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:39.658279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a0ab6-3fd6-4b89-8289-15b2aaeb4110 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:39.710072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WARNING keystone.common.rbac_enforcer.enforcer [None req-259a0ab6-3fd6-4b89-8289-15b2aaeb4110 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:17:39.710477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a0ab6-3fd6-4b89-8289-15b2aaeb4110 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:39.721491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 3/4] 10.222.0.78 () {58 vars in 1324 bytes} [Wed Aug 24 03:17:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:17:39.729273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:39.753133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14aeda-50f1-472f-90a8-b6e1e84ac3c9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:39.759633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11d5f7-8604-4975-b4e4-fbf4858527af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:39.760919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11d5f7-8604-4975-b4e4-fbf4858527af admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:39.761203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11d5f7-8604-4975-b4e4-fbf4858527af admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:39.761506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11d5f7-8604-4975-b4e4-fbf4858527af admin admin] PATH_INFO: `/v3/projects/7911c9363a5f49a3b74eb85a8f08a450` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:39.763391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11d5f7-8604-4975-b4e4-fbf4858527af admin admin] RBAC: Authorizing `identity:get_project(project_id=7911c9363a5f49a3b74eb85a8f08a450)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:39.822417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a11d5f7-8604-4975-b4e4-fbf4858527af admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:17:39.822778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11d5f7-8604-4975-b4e4-fbf4858527af admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:39.828549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 2/5] 10.222.0.78 () {56 vars in 1207 bytes} [Wed Aug 24 03:17:39 2022] GET /identity/v3/projects/7911c9363a5f49a3b74eb85a8f08a450 => generated 344 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:17:41.912145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62dc6c-9fb2-4f5f-b85e-40ca253566f6 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:41.912758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62dc6c-9fb2-4f5f-b85e-40ca253566f6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:41.912911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62dc6c-9fb2-4f5f-b85e-40ca253566f6 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:41.918799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 4/6] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:17:41.925504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5010d3-78a0-4628-b907-078035ea5fb5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:41.926011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5010d3-78a0-4628-b907-078035ea5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:41.926105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5010d3-78a0-4628-b907-078035ea5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:41.947326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8d5010d3-78a0-4628-b907-078035ea5fb5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:41.949235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8d5010d3-78a0-4628-b907-078035ea5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:41.957975 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 3/7] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 03:17:42.264884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62dc6c-9fb2-4f5f-b85e-40ca253566f6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:42.280617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62dc6c-9fb2-4f5f-b85e-40ca253566f6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:42.289891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d5107-32a6-40fe-bcf0-43012e4d1f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:42.290794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d5107-32a6-40fe-bcf0-43012e4d1f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:42.291069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d5107-32a6-40fe-bcf0-43012e4d1f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:42.291340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d5107-32a6-40fe-bcf0-43012e4d1f92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:42.300989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d5107-32a6-40fe-bcf0-43012e4d1f92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:42.303123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d5107-32a6-40fe-bcf0-43012e4d1f92 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:42.315265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 5/8] 10.222.0.78 () {58 vars in 1324 bytes} [Wed Aug 24 03:17:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:17:42.322208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5010d3-78a0-4628-b907-078035ea5fb5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:42.337299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5010d3-78a0-4628-b907-078035ea5fb5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:42.344293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb516679-3bc3-431b-864e-25f062f97027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:42.345122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb516679-3bc3-431b-864e-25f062f97027 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:42.345565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb516679-3bc3-431b-864e-25f062f97027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:42.345974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb516679-3bc3-431b-864e-25f062f97027 admin admin] PATH_INFO: `/v3/users/4cd618c84674445b8b18062be3eac4f8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:42.347527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb516679-3bc3-431b-864e-25f062f97027 admin admin] RBAC: Authorizing `identity:get_user(user_id=4cd618c84674445b8b18062be3eac4f8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:42.349402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb516679-3bc3-431b-864e-25f062f97027 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:42.351150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 4/9] 10.222.0.78 () {56 vars in 1198 bytes} [Wed Aug 24 03:17:42 2022] GET /identity/v3/users/4cd618c84674445b8b18062be3eac4f8 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:44.430357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fe04a-3e57-4076-8e3a-9a35f68e56e6 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:44.431082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fe04a-3e57-4076-8e3a-9a35f68e56e6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:44.431082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fe04a-3e57-4076-8e3a-9a35f68e56e6 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:44.432304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:44.438889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aebf67-af30-4ed5-a5a8-f985f4269b96 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:44.439518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aebf67-af30-4ed5-a5a8-f985f4269b96 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:44.439811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aebf67-af30-4ed5-a5a8-f985f4269b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:44.463420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b159a-62c2-4b7b-b8d7-01e44925dafd None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:44.463710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-30aebf67-af30-4ed5-a5a8-f985f4269b96 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:44.463858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b159a-62c2-4b7b-b8d7-01e44925dafd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:44.464005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b159a-62c2-4b7b-b8d7-01e44925dafd None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:44.464822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-30aebf67-af30-4ed5-a5a8-f985f4269b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:44.465241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 7/11] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:17:44.471681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dfe8a-554c-4afb-a4e7-30c649b724ea None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:44.472062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dfe8a-554c-4afb-a4e7-30c649b724ea None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:44.472408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dfe8a-554c-4afb-a4e7-30c649b724ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:44.520602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG passlib.handlers.bcrypt [None req-c68dfe8a-554c-4afb-a4e7-30c649b724ea None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81535) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:17:44.521132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG passlib.handlers.bcrypt [None req-c68dfe8a-554c-4afb-a4e7-30c649b724ea None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81535) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:17:44.564123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 5/12] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:17:44.566845 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c68dfe8a-554c-4afb-a4e7-30c649b724ea None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:44.568748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c68dfe8a-554c-4afb-a4e7-30c649b724ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:44.693228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 8/13] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:17:44.855062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aebf67-af30-4ed5-a5a8-f985f4269b96 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:44.899009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:44.972396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dfe8a-554c-4afb-a4e7-30c649b724ea None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:45.003210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aebf67-af30-4ed5-a5a8-f985f4269b96 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:45.058943 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a30e1-11eb-4bbf-9e77-610e991768dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:45.059697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a30e1-11eb-4bbf-9e77-610e991768dc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:45.059978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a30e1-11eb-4bbf-9e77-610e991768dc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:45.060253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a30e1-11eb-4bbf-9e77-610e991768dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:45.074981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a30e1-11eb-4bbf-9e77-610e991768dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d98a30e1-11eb-4bbf-9e77-610e991768dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:17:45.086464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:17:45.087551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:17:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 6/14] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:17:45.093847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a30e1-11eb-4bbf-9e77-610e991768dc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:45.130727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dfe8a-554c-4afb-a4e7-30c649b724ea None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:45.133757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:45.192669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2cd89-2c7d-4851-9fbe-3a7528036232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:45.194205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2cd89-2c7d-4851-9fbe-3a7528036232 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:45.194764 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2cd89-2c7d-4851-9fbe-3a7528036232 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:45.195264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2cd89-2c7d-4851-9fbe-3a7528036232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:45.202903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:45.232904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a30e1-11eb-4bbf-9e77-610e991768dc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:45.276914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1af9-14ef-4c6b-b781-52c217c8148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:45.277799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1af9-14ef-4c6b-b781-52c217c8148b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:45.278081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1af9-14ef-4c6b-b781-52c217c8148b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:45.278350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1af9-14ef-4c6b-b781-52c217c8148b None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:45.279084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1af9-14ef-4c6b-b781-52c217c8148b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:17:45.279385 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1af9-14ef-4c6b-b781-52c217c8148b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:45.280820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1af9-14ef-4c6b-b781-52c217c8148b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:45.285021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2cd89-2c7d-4851-9fbe-3a7528036232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:45.286803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2cd89-2c7d-4851-9fbe-3a7528036232 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:45.294891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 7/15] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:17:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:17:45.300741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1af9-14ef-4c6b-b781-52c217c8148b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:45.413024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 9/16] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:17:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:45.420965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2cd89-2c7d-4851-9fbe-3a7528036232 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:45.424581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1af9-14ef-4c6b-b781-52c217c8148b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:45.425701 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:45.472319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bcab5-e1c3-4d20-822f-c841ba0e623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:45.473101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bcab5-e1c3-4d20-822f-c841ba0e623e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:45.473325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bcab5-e1c3-4d20-822f-c841ba0e623e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:45.473705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bcab5-e1c3-4d20-822f-c841ba0e623e None admin] PATH_INFO: `/v3/users/4cd618c84674445b8b18062be3eac4f8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:45.475153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bcab5-e1c3-4d20-822f-c841ba0e623e None admin] RBAC: Authorizing `identity:get_user(user_id=4cd618c84674445b8b18062be3eac4f8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:45.476733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bcab5-e1c3-4d20-822f-c841ba0e623e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:45.478928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 8/17] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:17:45 2022] GET /identity/v3/users/4cd618c84674445b8b18062be3eac4f8 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:17:45.485699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bcab5-e1c3-4d20-822f-c841ba0e623e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:45.509772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:45.553012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2cd89-2c7d-4851-9fbe-3a7528036232 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:45.603501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe07b8f-156a-466e-bee2-e3e27c232b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:45.604650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07b8f-156a-466e-bee2-e3e27c232b82 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:45.605019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07b8f-156a-466e-bee2-e3e27c232b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:45.605543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07b8f-156a-466e-bee2-e3e27c232b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:45.609133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bcab5-e1c3-4d20-822f-c841ba0e623e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:45.627615 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe07b8f-156a-466e-bee2-e3e27c232b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:45.629110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe07b8f-156a-466e-bee2-e3e27c232b82 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-2fe07b8f-156a-466e-bee2-e3e27c232b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:17:45.648712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:17:45.650471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:17:45.652009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:17:45.652009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:17:45.652009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:17:45.652009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 10/18] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:17:45.656011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe07b8f-156a-466e-bee2-e3e27c232b82 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:45.659027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f84b-f9ee-478f-85ab-3581ef436277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:45.659751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f84b-f9ee-478f-85ab-3581ef436277 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:45.660026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f84b-f9ee-478f-85ab-3581ef436277 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:45.660297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f84b-f9ee-478f-85ab-3581ef436277 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:45.661805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6f84b-f9ee-478f-85ab-3581ef436277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:45.664243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6f84b-f9ee-478f-85ab-3581ef436277 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:45.666154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 9/19] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:17:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:17:45.673038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f84b-f9ee-478f-85ab-3581ef436277 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:45.734472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:45.781652 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:45.784922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe07b8f-156a-466e-bee2-e3e27c232b82 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:45.811173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f84b-f9ee-478f-85ab-3581ef436277 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:45.830107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3083573-35c9-4789-a277-630f73e7fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:45.830763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3083573-35c9-4789-a277-630f73e7fd8c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:45.831041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3083573-35c9-4789-a277-630f73e7fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:45.831315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3083573-35c9-4789-a277-630f73e7fd8c None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:45.832017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3083573-35c9-4789-a277-630f73e7fd8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:17:45.832319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3083573-35c9-4789-a277-630f73e7fd8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:45.833719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3083573-35c9-4789-a277-630f73e7fd8c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:45.855146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 11/20] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:17:45.862601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810baa71-d4bf-48d2-a4a7-083b954c850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:45.863520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baa71-d4bf-48d2-a4a7-083b954c850b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:45.863984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baa71-d4bf-48d2-a4a7-083b954c850b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:45.864452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baa71-d4bf-48d2-a4a7-083b954c850b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:45.866036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810baa71-d4bf-48d2-a4a7-083b954c850b None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.domain.id=default, user.id=4cd618c84674445b8b18062be3eac4f8) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:17:45.866586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810baa71-d4bf-48d2-a4a7-083b954c850b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:45.869729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810baa71-d4bf-48d2-a4a7-083b954c850b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:45.879922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 10/21] 10.222.0.78 () {56 vars in 1322 bytes} [Wed Aug 24 03:17:45 2022] GET /identity/v3/role_assignments?user.id=4cd618c84674445b8b18062be3eac4f8&scope.domain.id=default&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 233 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:17:48.346356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e838-42d8-4c89-99e8-127d3f6c5047 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:48.347313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e838-42d8-4c89-99e8-127d3f6c5047 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:48.347745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e838-42d8-4c89-99e8-127d3f6c5047 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:48.349378 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 12/22] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:48.355834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf045660-ba94-4a45-82a7-6ab375aaed4f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:48.356831 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf045660-ba94-4a45-82a7-6ab375aaed4f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:48.357496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf045660-ba94-4a45-82a7-6ab375aaed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:48.386883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cf045660-ba94-4a45-82a7-6ab375aaed4f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:48.388494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cf045660-ba94-4a45-82a7-6ab375aaed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:48.452460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df724f1-f743-49eb-a5d8-03b6558d361e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:48.453215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df724f1-f743-49eb-a5d8-03b6558d361e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:48.453920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df724f1-f743-49eb-a5d8-03b6558d361e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:48.456022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 13/23] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:48.467081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d986ab-9473-4db9-a124-7e788eda02fe None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:48.468027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d986ab-9473-4db9-a124-7e788eda02fe None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:48.468861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d986ab-9473-4db9-a124-7e788eda02fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:48.515851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f1d986ab-9473-4db9-a124-7e788eda02fe None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:48.517482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f1d986ab-9473-4db9-a124-7e788eda02fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:48.533416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 11/24] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:17:48.593725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388b66c-d78f-4488-913b-4df75b4cb2d5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:48.593725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388b66c-d78f-4488-913b-4df75b4cb2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:48.593725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388b66c-d78f-4488-913b-4df75b4cb2d5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:48.596503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 12/25] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:17:48.605784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77a3c5-380c-49d1-8ee9-ba2194290306 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:48.606288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77a3c5-380c-49d1-8ee9-ba2194290306 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:48.606737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77a3c5-380c-49d1-8ee9-ba2194290306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:48.646853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fd77a3c5-380c-49d1-8ee9-ba2194290306 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:48.648718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fd77a3c5-380c-49d1-8ee9-ba2194290306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:48.677294 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 14/26] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:17:48.778276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 13/27] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:17:48.927172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6802-866a-453c-81f4-d0c8654a3585 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:48.927662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6802-866a-453c-81f4-d0c8654a3585 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:48.928134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6802-866a-453c-81f4-d0c8654a3585 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:48.929633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 15/28] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:48.941922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eeaf6-4381-4162-bf26-70f9b4f08554 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:48.942464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eeaf6-4381-4162-bf26-70f9b4f08554 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:48.942948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eeaf6-4381-4162-bf26-70f9b4f08554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:48.957141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:48.983422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-089eeaf6-4381-4162-bf26-70f9b4f08554 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:48.985408 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-089eeaf6-4381-4162-bf26-70f9b4f08554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:49.111557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6802-866a-453c-81f4-d0c8654a3585 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:49.134602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 14/29] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:17:49.174077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eeaf6-4381-4162-bf26-70f9b4f08554 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:49.284632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:49.333901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eeaf6-4381-4162-bf26-70f9b4f08554 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:49.376871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ead94-5d2f-4712-a901-fdc05c10e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:49.377540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ead94-5d2f-4712-a901-fdc05c10e06b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:49.377790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ead94-5d2f-4712-a901-fdc05c10e06b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:49.378062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ead94-5d2f-4712-a901-fdc05c10e06b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:49.380962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:49.397246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ead94-5d2f-4712-a901-fdc05c10e06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:17:49.404765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6802-866a-453c-81f4-d0c8654a3585 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-425ead94-5d2f-4712-a901-fdc05c10e06b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:17:49.407737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:17:49.408567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 15/30] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:17:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:17:49.409978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ead94-5d2f-4712-a901-fdc05c10e06b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:49.492001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28282e6f-146e-472b-bc20-64772f8dba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:49.492666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28282e6f-146e-472b-bc20-64772f8dba85 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:49.492948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28282e6f-146e-472b-bc20-64772f8dba85 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:49.493259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28282e6f-146e-472b-bc20-64772f8dba85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:49.512894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28282e6f-146e-472b-bc20-64772f8dba85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:49.514404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28282e6f-146e-472b-bc20-64772f8dba85 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-28282e6f-146e-472b-bc20-64772f8dba85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:17:49.546043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:17:49.548189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:17:49.550218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:17:49.550218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:17:49.550218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:17:49.550218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 16/31] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:17:49.550218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28282e6f-146e-472b-bc20-64772f8dba85 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:49.564251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ead94-5d2f-4712-a901-fdc05c10e06b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:49.615641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57e55-7937-4d88-aaa7-a0f7b6dcf7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:49.616411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57e55-7937-4d88-aaa7-a0f7b6dcf7a0 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:49.617149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57e55-7937-4d88-aaa7-a0f7b6dcf7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:49.617431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57e55-7937-4d88-aaa7-a0f7b6dcf7a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:49.618122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d57e55-7937-4d88-aaa7-a0f7b6dcf7a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:49.619678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d57e55-7937-4d88-aaa7-a0f7b6dcf7a0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:49.684337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28282e6f-146e-472b-bc20-64772f8dba85 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:49.686135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:49.744939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e259-8fec-4941-8fa6-3e730574ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:49.745811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e259-8fec-4941-8fa6-3e730574ff77 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:49.746228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e259-8fec-4941-8fa6-3e730574ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:49.746687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e259-8fec-4941-8fa6-3e730574ff77 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:49.747512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e259-8fec-4941-8fa6-3e730574ff77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:17:49.747967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e259-8fec-4941-8fa6-3e730574ff77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:49.749510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e259-8fec-4941-8fa6-3e730574ff77 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:49.763856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 17/32] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:17:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:49.764942 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e259-8fec-4941-8fa6-3e730574ff77 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:49.781893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 16/33] 10.222.0.78 () {60 vars in 1131 bytes} [Wed Aug 24 03:17:49 2022] POST /identity/v3/roles => generated 219 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:17:49.783230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57e55-7937-4d88-aaa7-a0f7b6dcf7a0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:49.871835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:49.931613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57e55-7937-4d88-aaa7-a0f7b6dcf7a0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:49.945404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e259-8fec-4941-8fa6-3e730574ff77 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:49.975005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844397-b9c5-40cd-974b-74ed9a101c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:49.975913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844397-b9c5-40cd-974b-74ed9a101c25 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:49.976479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844397-b9c5-40cd-974b-74ed9a101c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:49.976950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844397-b9c5-40cd-974b-74ed9a101c25 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:49.977882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12844397-b9c5-40cd-974b-74ed9a101c25 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:49.979690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12844397-b9c5-40cd-974b-74ed9a101c25 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:49.989012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc582914-2c66-49c1-90b3-0c8558291d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:49.989935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc582914-2c66-49c1-90b3-0c8558291d4d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:49.990240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc582914-2c66-49c1-90b3-0c8558291d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:49.990500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc582914-2c66-49c1-90b3-0c8558291d4d None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:49.991947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc582914-2c66-49c1-90b3-0c8558291d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:17:49.992407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc582914-2c66-49c1-90b3-0c8558291d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:49.994131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc582914-2c66-49c1-90b3-0c8558291d4d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:50.001568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 17/34] 10.222.0.78 () {60 vars in 1131 bytes} [Wed Aug 24 03:17:49 2022] POST /identity/v3/roles => generated 225 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:17:50.002641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844397-b9c5-40cd-974b-74ed9a101c25 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:50.009321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 18/35] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:50.011073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b72e7-9f8f-4a4d-8d53-d0a6d9cd01f7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:50.011579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b72e7-9f8f-4a4d-8d53-d0a6d9cd01f7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:50.012018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b72e7-9f8f-4a4d-8d53-d0a6d9cd01f7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:50.013807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:50.014903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b72e7-9f8f-4a4d-8d53-d0a6d9cd01f7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:50.053820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:50.158152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844397-b9c5-40cd-974b-74ed9a101c25 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:50.172756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b72e7-9f8f-4a4d-8d53-d0a6d9cd01f7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:50.181232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:50.210691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250523b-c44f-4cc6-815c-cabb609c0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:50.211368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250523b-c44f-4cc6-815c-cabb609c0b29 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:50.211645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250523b-c44f-4cc6-815c-cabb609c0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:50.211916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250523b-c44f-4cc6-815c-cabb609c0b29 None admin] PATH_INFO: `/v3/users/4cd618c84674445b8b18062be3eac4f8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:50.213510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250523b-c44f-4cc6-815c-cabb609c0b29 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd618c84674445b8b18062be3eac4f8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:50.214574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250523b-c44f-4cc6-815c-cabb609c0b29 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:50.216249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 18/37] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:17:50 2022] GET /identity/v3/users/4cd618c84674445b8b18062be3eac4f8 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:50.217570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d9ae3-feb0-4648-a9c5-304d9c77a3f4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:50.217857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d9ae3-feb0-4648-a9c5-304d9c77a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:50.218136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d9ae3-feb0-4648-a9c5-304d9c77a3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:50.228532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd20b2-7c32-4ca1-af0f-f7256a3c0978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:50.229163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd20b2-7c32-4ca1-af0f-f7256a3c0978 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:50.229439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd20b2-7c32-4ca1-af0f-f7256a3c0978 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:50.229706 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd20b2-7c32-4ca1-af0f-f7256a3c0978 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:50.230619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd20b2-7c32-4ca1-af0f-f7256a3c0978 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:50.232268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd20b2-7c32-4ca1-af0f-f7256a3c0978 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:50.240551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-202d9ae3-feb0-4648-a9c5-304d9c77a3f4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:50.240967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-202d9ae3-feb0-4648-a9c5-304d9c77a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:50.314572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 19/38] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:17:50.316341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e975d-c003-43e3-a346-294577b372d4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:50.316634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e975d-c003-43e3-a346-294577b372d4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:50.316915 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e975d-c003-43e3-a346-294577b372d4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:50.322716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 20/39] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:50.322716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e975d-c003-43e3-a346-294577b372d4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:50.387108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 20/40] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:17:50 2022] POST /identity/v3/projects => generated 301 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:17:50.389086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d1bdf-62fa-488a-8c6d-894c07f67efe None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:50.389548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d1bdf-62fa-488a-8c6d-894c07f67efe None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:50.389890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d1bdf-62fa-488a-8c6d-894c07f67efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:50.421614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1d7d1bdf-62fa-488a-8c6d-894c07f67efe None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:50.423723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1d7d1bdf-62fa-488a-8c6d-894c07f67efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:50.459518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e975d-c003-43e3-a346-294577b372d4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:50.482860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:50.516377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f261e-859d-4fdc-b5da-f28fa5f831a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:50.518087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f261e-859d-4fdc-b5da-f28fa5f831a7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:50.518869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f261e-859d-4fdc-b5da-f28fa5f831a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:50.519166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f261e-859d-4fdc-b5da-f28fa5f831a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:50.520466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f261e-859d-4fdc-b5da-f28fa5f831a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:50.523044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f261e-859d-4fdc-b5da-f28fa5f831a7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:50.530693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 21/41] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:17:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:50.533027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f261e-859d-4fdc-b5da-f28fa5f831a7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:50.538186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 21/42] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:17:50.608521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d1bdf-62fa-488a-8c6d-894c07f67efe None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:50.612820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:50.672925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f261e-859d-4fdc-b5da-f28fa5f831a7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:50.710349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917f6b-8aa9-4659-87e9-f745de59978e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:50.711090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917f6b-8aa9-4659-87e9-f745de59978e None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:50.711371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917f6b-8aa9-4659-87e9-f745de59978e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:50.711647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917f6b-8aa9-4659-87e9-f745de59978e None admin] PATH_INFO: `/v3/domains/default/users/4cd618c84674445b8b18062be3eac4f8/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:50.713715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa917f6b-8aa9-4659-87e9-f745de59978e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4cd618c84674445b8b18062be3eac4f8, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:50.715257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa917f6b-8aa9-4659-87e9-f745de59978e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:50.734113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 22/43] 10.222.0.78 () {58 vars in 1361 bytes} [Wed Aug 24 03:17:50 2022] PUT /identity/v3/domains/default/users/4cd618c84674445b8b18062be3eac4f8/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:17:50.753475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d1bdf-62fa-488a-8c6d-894c07f67efe None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:50.798417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3655e2a-f19d-48ac-8d06-e1e8e9f53a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:50.799324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655e2a-f19d-48ac-8d06-e1e8e9f53a7c None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:50.799429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655e2a-f19d-48ac-8d06-e1e8e9f53a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:50.799677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655e2a-f19d-48ac-8d06-e1e8e9f53a7c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:50.800386 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3655e2a-f19d-48ac-8d06-e1e8e9f53a7c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:50.802434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3655e2a-f19d-48ac-8d06-e1e8e9f53a7c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:50.822727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 22/44] 10.222.0.78 () {60 vars in 1131 bytes} [Wed Aug 24 03:17:50 2022] POST /identity/v3/roles => generated 223 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:17:50.823306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917f6b-8aa9-4659-87e9-f745de59978e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:50.880543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:50.959688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917f6b-8aa9-4659-87e9-f745de59978e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:51.002716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bba87-0668-48f7-82c1-63c0c72cb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:51.003336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bba87-0668-48f7-82c1-63c0c72cb46d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:51.003688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bba87-0668-48f7-82c1-63c0c72cb46d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:51.003963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bba87-0668-48f7-82c1-63c0c72cb46d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:51.005187 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bba87-0668-48f7-82c1-63c0c72cb46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:51.006772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bba87-0668-48f7-82c1-63c0c72cb46d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:51.008643 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 23/45] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:17:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:17:51.014778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3655e2a-f19d-48ac-8d06-e1e8e9f53a7c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:51.093008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:51.136673 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3655e2a-f19d-48ac-8d06-e1e8e9f53a7c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:51.172763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cce4b8-fcea-4cd4-a1b9-f19d07c3e768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:51.173956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cce4b8-fcea-4cd4-a1b9-f19d07c3e768 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:51.174517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cce4b8-fcea-4cd4-a1b9-f19d07c3e768 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:51.175071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cce4b8-fcea-4cd4-a1b9-f19d07c3e768 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:51.176196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cce4b8-fcea-4cd4-a1b9-f19d07c3e768 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:51.179083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cce4b8-fcea-4cd4-a1b9-f19d07c3e768 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:51.221927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 23/46] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:17:51 2022] POST /identity/v3/projects => generated 312 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:17:52.713439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d10569-0514-43cd-8cf6-ba64701241ff None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:52.713995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d10569-0514-43cd-8cf6-ba64701241ff None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:52.713995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d10569-0514-43cd-8cf6-ba64701241ff None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:52.715797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 24/47] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:52.721530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68a856-95db-4f94-b1d7-44fb9de578d7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:52.721940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68a856-95db-4f94-b1d7-44fb9de578d7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:52.722083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68a856-95db-4f94-b1d7-44fb9de578d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:52.742761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-df68a856-95db-4f94-b1d7-44fb9de578d7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:52.744025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-df68a856-95db-4f94-b1d7-44fb9de578d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:52.815167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 24/48] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:17:53.079748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d10569-0514-43cd-8cf6-ba64701241ff None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:53.239180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f739b36-f55f-4472-822c-f85591309e5e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:53.239689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f739b36-f55f-4472-822c-f85591309e5e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:53.239689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f739b36-f55f-4472-822c-f85591309e5e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:53.242049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 25/49] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:17:53.248358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ad64-3785-4fc4-a264-7df1466e2fdc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:53.248635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ad64-3785-4fc4-a264-7df1466e2fdc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:53.248908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ad64-3785-4fc4-a264-7df1466e2fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:53.269391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9224ad64-3785-4fc4-a264-7df1466e2fdc None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:53.270610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9224ad64-3785-4fc4-a264-7df1466e2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:53.300407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d10569-0514-43cd-8cf6-ba64701241ff None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:53.310531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:53.322304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:53.338159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc07062-86ec-4c87-896d-4227ee9c8e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:53.338756 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc07062-86ec-4c87-896d-4227ee9c8e9b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:53.339043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc07062-86ec-4c87-896d-4227ee9c8e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:53.339319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc07062-86ec-4c87-896d-4227ee9c8e9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:53.350330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc07062-86ec-4c87-896d-4227ee9c8e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:17:53.351033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 26/50] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0fc07062-86ec-4c87-896d-4227ee9c8e9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:17:53.355166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:17:53.356226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:17:53.356973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 25/51] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:17:53.361998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224ad64-3785-4fc4-a264-7df1466e2fdc None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:53.484852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224ad64-3785-4fc4-a264-7df1466e2fdc None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:53.523170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ffb1d-1651-4eb2-b057-a2cb74e5ee78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:53.523783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ffb1d-1651-4eb2-b057-a2cb74e5ee78 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:53.524058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ffb1d-1651-4eb2-b057-a2cb74e5ee78 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:53.524300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ffb1d-1651-4eb2-b057-a2cb74e5ee78 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:53.525002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ffb1d-1651-4eb2-b057-a2cb74e5ee78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:17:53.525306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ffb1d-1651-4eb2-b057-a2cb74e5ee78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:53.526677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ffb1d-1651-4eb2-b057-a2cb74e5ee78 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:53.535158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 27/52] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:53.541631 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc07062-86ec-4c87-896d-4227ee9c8e9b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:53.629602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ffb1d-1651-4eb2-b057-a2cb74e5ee78 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:53.650942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc07062-86ec-4c87-896d-4227ee9c8e9b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:53.666487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:53.689049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fed02-0cc9-42e7-bc43-39ac0e3b30f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:53.689691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fed02-0cc9-42e7-bc43-39ac0e3b30f2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:53.689974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fed02-0cc9-42e7-bc43-39ac0e3b30f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:53.690249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fed02-0cc9-42e7-bc43-39ac0e3b30f2 None admin] PATH_INFO: `/v3/users/4cd618c84674445b8b18062be3eac4f8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:53.691453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fed02-0cc9-42e7-bc43-39ac0e3b30f2 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd618c84674445b8b18062be3eac4f8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:53.692950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fed02-0cc9-42e7-bc43-39ac0e3b30f2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:53.695000 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:17:53 2022] GET /identity/v3/users/4cd618c84674445b8b18062be3eac4f8 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:53.701383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fed02-0cc9-42e7-bc43-39ac0e3b30f2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:53.738891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:53.739683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ffb1d-1651-4eb2-b057-a2cb74e5ee78 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:53.777069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a5a7d-3f38-493d-9089-b53ab69992ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:53.777713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a5a7d-3f38-493d-9089-b53ab69992ca None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:53.777995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a5a7d-3f38-493d-9089-b53ab69992ca None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:53.778321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a5a7d-3f38-493d-9089-b53ab69992ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:53.779809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a5a7d-3f38-493d-9089-b53ab69992ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:53.781273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a5a7d-3f38-493d-9089-b53ab69992ca None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:53.782972 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 28/54] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:17:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:53.788787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a5a7d-3f38-493d-9089-b53ab69992ca None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:53.809713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fed02-0cc9-42e7-bc43-39ac0e3b30f2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:53.846008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb536-cfae-4df4-b449-51f0ffa81df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:53.846677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb536-cfae-4df4-b449-51f0ffa81df4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:53.846967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb536-cfae-4df4-b449-51f0ffa81df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:53.847241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb536-cfae-4df4-b449-51f0ffa81df4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:53.848602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfb536-cfae-4df4-b449-51f0ffa81df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:53.850466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfb536-cfae-4df4-b449-51f0ffa81df4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:53.852139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:17:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:17:53.858121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb536-cfae-4df4-b449-51f0ffa81df4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:53.893505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a5a7d-3f38-493d-9089-b53ab69992ca None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:53.895789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:53.931064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e7a95-8138-4c9c-8ff4-d1130884b929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:53.931818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7a95-8138-4c9c-8ff4-d1130884b929 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:53.932098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7a95-8138-4c9c-8ff4-d1130884b929 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:53.932374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7a95-8138-4c9c-8ff4-d1130884b929 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:53.933013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e7a95-8138-4c9c-8ff4-d1130884b929 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:53.934496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e7a95-8138-4c9c-8ff4-d1130884b929 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:53.963561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 29/56] 10.222.0.78 () {60 vars in 1140 bytes} [Wed Aug 24 03:17:53 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:17:53.966762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb536-cfae-4df4-b449-51f0ffa81df4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:53.969491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:54.009767 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6023a-f4c8-45a6-adef-31fbadd8c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:54.010411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6023a-f4c8-45a6-adef-31fbadd8c4ba None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:54.010729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6023a-f4c8-45a6-adef-31fbadd8c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:54.011011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6023a-f4c8-45a6-adef-31fbadd8c4ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:54.011777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6023a-f4c8-45a6-adef-31fbadd8c4ba None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.domain.id=default, user.id=4cd618c84674445b8b18062be3eac4f8) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:17:54.012088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6023a-f4c8-45a6-adef-31fbadd8c4ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:54.013647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6023a-f4c8-45a6-adef-31fbadd8c4ba None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:54.020999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1322 bytes} [Wed Aug 24 03:17:53 2022] GET /identity/v3/role_assignments?user.id=4cd618c84674445b8b18062be3eac4f8&scope.domain.id=default&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 530 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:17:55.903343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784d81-968c-48ba-af20-f6a9114260b2 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:55.903857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784d81-968c-48ba-af20-f6a9114260b2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:55.903857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784d81-968c-48ba-af20-f6a9114260b2 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:55.905172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 30/58] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:55.911189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04453b-b38e-4bd1-9c06-982d0693bf97 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:55.911684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04453b-b38e-4bd1-9c06-982d0693bf97 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:55.911770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04453b-b38e-4bd1-9c06-982d0693bf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:55.939623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2b04453b-b38e-4bd1-9c06-982d0693bf97 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:55.940856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2b04453b-b38e-4bd1-9c06-982d0693bf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:56.019836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 29/59] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:17:56.296034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4784d81-968c-48ba-af20-f6a9114260b2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:56.520087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4784d81-968c-48ba-af20-f6a9114260b2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:56.553930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4b6a-48fc-4136-adf5-7a175b824af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:56.554491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4b6a-48fc-4136-adf5-7a175b824af9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:56.554800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4b6a-48fc-4136-adf5-7a175b824af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:56.555072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4b6a-48fc-4136-adf5-7a175b824af9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:56.556270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f4b6a-48fc-4136-adf5-7a175b824af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:56.557710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f4b6a-48fc-4136-adf5-7a175b824af9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:56.559327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 31/60] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:17:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:17:56.565212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04453b-b38e-4bd1-9c06-982d0693bf97 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:17:56.672588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:56.677056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04453b-b38e-4bd1-9c06-982d0693bf97 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:17:56.714475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37904d-d6ec-4324-be59-4fd265aed09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:17:56.715124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37904d-d6ec-4324-be59-4fd265aed09f None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:56.715401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37904d-d6ec-4324-be59-4fd265aed09f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:56.715675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37904d-d6ec-4324-be59-4fd265aed09f None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:56.716323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37904d-d6ec-4324-be59-4fd265aed09f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:17:56.717785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37904d-d6ec-4324-be59-4fd265aed09f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:17:56.747009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 30/61] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:17:56 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:17:59.678690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a342b-0ab0-4ed6-9e84-806f3866e88e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:59.679224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a342b-0ab0-4ed6-9e84-806f3866e88e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:59.679224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a342b-0ab0-4ed6-9e84-806f3866e88e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:59.680616 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 32/62] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:59.686115 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea419f-f394-4764-b1b8-7bbe998e61b8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:59.686538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea419f-f394-4764-b1b8-7bbe998e61b8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:59.686740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea419f-f394-4764-b1b8-7bbe998e61b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:59.708257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d2ea419f-f394-4764-b1b8-7bbe998e61b8 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:59.709773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d2ea419f-f394-4764-b1b8-7bbe998e61b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:17:59.814057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 31/63] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:17:59.902693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51630517-7742-43e3-a274-cc9b01d2ee46 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:59.903316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51630517-7742-43e3-a274-cc9b01d2ee46 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:59.903779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51630517-7742-43e3-a274-cc9b01d2ee46 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:59.905350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 33/64] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:17:59.911007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04eabf-a416-4577-b5d8-c7ba50a114bb None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:17:59.911580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04eabf-a416-4577-b5d8-c7ba50a114bb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:17:59.912114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04eabf-a416-4577-b5d8-c7ba50a114bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:17:59.938848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3e04eabf-a416-4577-b5d8-c7ba50a114bb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:17:59.940451 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e04eabf-a416-4577-b5d8-c7ba50a114bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:00.045407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 32/65] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:00.197774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51630517-7742-43e3-a274-cc9b01d2ee46 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:00.230483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:00.303509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b5d49-efd6-4e39-b169-87c68bc6f762 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.303995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b5d49-efd6-4e39-b169-87c68bc6f762 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.304121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b5d49-efd6-4e39-b169-87c68bc6f762 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.305620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 33/66] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:18:00.310615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607258-8bac-40c8-ad73-9d1f55c46e2a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.311102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607258-8bac-40c8-ad73-9d1f55c46e2a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.311552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607258-8bac-40c8-ad73-9d1f55c46e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.336059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51630517-7742-43e3-a274-cc9b01d2ee46 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:00.348401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-19607258-8bac-40c8-ad73-9d1f55c46e2a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:00.350761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-19607258-8bac-40c8-ad73-9d1f55c46e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:00.361683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:00.375752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3ddfb-a2da-4154-bb77-7c7c75fa9652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:00.376397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ddfb-a2da-4154-bb77-7c7c75fa9652 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.376672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ddfb-a2da-4154-bb77-7c7c75fa9652 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.376967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ddfb-a2da-4154-bb77-7c7c75fa9652 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.390119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3ddfb-a2da-4154-bb77-7c7c75fa9652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-bff3ddfb-a2da-4154-bb77-7c7c75fa9652 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:00.397586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:00.398643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 34/67] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:00.399567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3ddfb-a2da-4154-bb77-7c7c75fa9652 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:00.441638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 34/68] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:00.443346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709195f-847a-4be5-a972-6f5a705996ff None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.444501 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709195f-847a-4be5-a972-6f5a705996ff None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.444978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709195f-847a-4be5-a972-6f5a705996ff None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.446515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 35/69] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:00.447445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709195f-847a-4be5-a972-6f5a705996ff None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:00.504280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:00.524728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3ddfb-a2da-4154-bb77-7c7c75fa9652 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:00.567033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd19f1-ebf5-4109-8258-862f9b12207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:00.568064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd19f1-ebf5-4109-8258-862f9b12207e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.569248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd19f1-ebf5-4109-8258-862f9b12207e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.569858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd19f1-ebf5-4109-8258-862f9b12207e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.577125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709195f-847a-4be5-a972-6f5a705996ff None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:00.586014 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd19f1-ebf5-4109-8258-862f9b12207e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-81bd19f1-ebf5-4109-8258-862f9b12207e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:00.592540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:00.593399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:00.594167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 35/70] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:00.601082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b9ec-e3ea-4afc-8fba-458dbcc1c414 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.601689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b9ec-e3ea-4afc-8fba-458dbcc1c414 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.602156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b9ec-e3ea-4afc-8fba-458dbcc1c414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.622536 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6185b9ec-e3ea-4afc-8fba-458dbcc1c414 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:00.623766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6185b9ec-e3ea-4afc-8fba-458dbcc1c414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:00.625536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fbca8-bbfb-4465-b771-c7b74fa65873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:00.626258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbca8-bbfb-4465-b771-c7b74fa65873 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.627477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbca8-bbfb-4465-b771-c7b74fa65873 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.628725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbca8-bbfb-4465-b771-c7b74fa65873 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.630196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fbca8-bbfb-4465-b771-c7b74fa65873 None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:00.630196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fbca8-bbfb-4465-b771-c7b74fa65873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:00.631455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fbca8-bbfb-4465-b771-c7b74fa65873 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:00.649606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 36/71] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:00.649606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fbca8-bbfb-4465-b771-c7b74fa65873 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:00.659455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:00.727534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 36/72] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:00.729502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af301b-8e1f-4daf-8a78-84103371e560 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.729949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af301b-8e1f-4daf-8a78-84103371e560 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.730519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af301b-8e1f-4daf-8a78-84103371e560 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.732037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 37/73] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:00.732957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af301b-8e1f-4daf-8a78-84103371e560 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:00.808027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fbca8-bbfb-4465-b771-c7b74fa65873 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:00.847282 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73ba7-2fab-4b23-84a0-fa7fd3a8edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:00.847898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73ba7-2fab-4b23-84a0-fa7fd3a8edee None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.848175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73ba7-2fab-4b23-84a0-fa7fd3a8edee None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.848442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73ba7-2fab-4b23-84a0-fa7fd3a8edee None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.849335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c73ba7-2fab-4b23-84a0-fa7fd3a8edee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:00.849668 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c73ba7-2fab-4b23-84a0-fa7fd3a8edee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:00.851111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c73ba7-2fab-4b23-84a0-fa7fd3a8edee None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:00.863557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 37/74] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:00.867913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73ba7-2fab-4b23-84a0-fa7fd3a8edee None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:00.868895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:00.910944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af301b-8e1f-4daf-8a78-84103371e560 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:00.950910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa67ad5-c535-41a9-a5c8-981ddb94ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:00.951567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa67ad5-c535-41a9-a5c8-981ddb94ab13 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.951848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa67ad5-c535-41a9-a5c8-981ddb94ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.952126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa67ad5-c535-41a9-a5c8-981ddb94ab13 None admin] PATH_INFO: `/v3/users/b81582df34a44b238abda1fb4c41a74a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:00.955259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:00.973892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa67ad5-c535-41a9-a5c8-981ddb94ab13 None admin] RBAC: Authorizing `identity:get_user(user_id=b81582df34a44b238abda1fb4c41a74a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:00.976440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa67ad5-c535-41a9-a5c8-981ddb94ab13 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:00.978674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 38/75] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:00 2022] GET /identity/v3/users/b81582df34a44b238abda1fb4c41a74a => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:00.981926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296f282-1efe-431d-b002-be44930c62e4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:00.982206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296f282-1efe-431d-b002-be44930c62e4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:00.982482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296f282-1efe-431d-b002-be44930c62e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.005185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c296f282-1efe-431d-b002-be44930c62e4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:01.006380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c296f282-1efe-431d-b002-be44930c62e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:01.007808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73ba7-2fab-4b23-84a0-fa7fd3a8edee None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:01.050360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a69e9f-12e4-4411-90a6-f0f2104330cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:01.051577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a69e9f-12e4-4411-90a6-f0f2104330cd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:01.051864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a69e9f-12e4-4411-90a6-f0f2104330cd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:01.052143 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a69e9f-12e4-4411-90a6-f0f2104330cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.064894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a69e9f-12e4-4411-90a6-f0f2104330cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a4a69e9f-12e4-4411-90a6-f0f2104330cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:01.070251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:01.071225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:01.071971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 38/76] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:01.072578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a69e9f-12e4-4411-90a6-f0f2104330cd None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.083432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 39/77] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:01.084415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296f282-1efe-431d-b002-be44930c62e4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.165611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:01.200582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a69e9f-12e4-4411-90a6-f0f2104330cd None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:01.211917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296f282-1efe-431d-b002-be44930c62e4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:01.231807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:01.240664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b67c4-0353-44e1-8017-c77f582589b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:01.241522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b67c4-0353-44e1-8017-c77f582589b1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:01.241761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b67c4-0353-44e1-8017-c77f582589b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:01.242043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b67c4-0353-44e1-8017-c77f582589b1 None admin] PATH_INFO: `/v3/users/4cd618c84674445b8b18062be3eac4f8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.243336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b67c4-0353-44e1-8017-c77f582589b1 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd618c84674445b8b18062be3eac4f8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:01.244997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b67c4-0353-44e1-8017-c77f582589b1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:01.246805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 39/78] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:01 2022] GET /identity/v3/users/4cd618c84674445b8b18062be3eac4f8 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:01.247603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b67c4-0353-44e1-8017-c77f582589b1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.257704 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bf50b-7fd1-4468-aaee-42b8cf528f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:01.259346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bf50b-7fd1-4468-aaee-42b8cf528f9b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:01.259895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bf50b-7fd1-4468-aaee-42b8cf528f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:01.261099 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bf50b-7fd1-4468-aaee-42b8cf528f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.338716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bf50b-7fd1-4468-aaee-42b8cf528f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:01.340524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bf50b-7fd1-4468-aaee-42b8cf528f9b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:01.363443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b67c4-0353-44e1-8017-c77f582589b1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:01.397884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30aa26-e75c-45e4-8b9d-6728142332d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:01.398528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30aa26-e75c-45e4-8b9d-6728142332d6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:01.398822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30aa26-e75c-45e4-8b9d-6728142332d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:01.399094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30aa26-e75c-45e4-8b9d-6728142332d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.402927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:01.409777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30aa26-e75c-45e4-8b9d-6728142332d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0c30aa26-e75c-45e4-8b9d-6728142332d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:01.415110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:01.415964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:01.416731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 40/79] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:01.417358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30aa26-e75c-45e4-8b9d-6728142332d6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.449273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 40/80] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:01.450234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bf50b-7fd1-4468-aaee-42b8cf528f9b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.498750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:01.546145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30aa26-e75c-45e4-8b9d-6728142332d6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:01.566045 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bf50b-7fd1-4468-aaee-42b8cf528f9b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:01.583405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127984b6-100b-40dc-8e3e-dbf8219b9618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:01.584401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127984b6-100b-40dc-8e3e-dbf8219b9618 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:01.584691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127984b6-100b-40dc-8e3e-dbf8219b9618 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:01.584956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127984b6-100b-40dc-8e3e-dbf8219b9618 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.585627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127984b6-100b-40dc-8e3e-dbf8219b9618 None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:01.585927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127984b6-100b-40dc-8e3e-dbf8219b9618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:01.589815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127984b6-100b-40dc-8e3e-dbf8219b9618 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:01.599282 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 41/81] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:01.600156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127984b6-100b-40dc-8e3e-dbf8219b9618 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.602346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a23b-6aca-4316-8291-c8259487c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:01.603012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a23b-6aca-4316-8291-c8259487c83a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:01.603287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a23b-6aca-4316-8291-c8259487c83a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:01.603558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a23b-6aca-4316-8291-c8259487c83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.635551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:01.675981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199a23b-6aca-4316-8291-c8259487c83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:01.677614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199a23b-6aca-4316-8291-c8259487c83a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:01.709053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127984b6-100b-40dc-8e3e-dbf8219b9618 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:01.728227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:01.746673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f17fd4-3300-4c82-986f-a2ffaa52a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:01.747328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f17fd4-3300-4c82-986f-a2ffaa52a98e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:01.747613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f17fd4-3300-4c82-986f-a2ffaa52a98e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:01.747888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f17fd4-3300-4c82-986f-a2ffaa52a98e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.749021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f17fd4-3300-4c82-986f-a2ffaa52a98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:01.750492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f17fd4-3300-4c82-986f-a2ffaa52a98e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:01.752123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 42/82] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:01.752905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f17fd4-3300-4c82-986f-a2ffaa52a98e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.781075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 41/83] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:01.781939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a23b-6aca-4316-8291-c8259487c83a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.843106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:01.861397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f17fd4-3300-4c82-986f-a2ffaa52a98e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:01.882539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a23b-6aca-4316-8291-c8259487c83a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:01.895711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe54bff-5469-4260-8fcc-1c2dc31644eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:01.896502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe54bff-5469-4260-8fcc-1c2dc31644eb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:01.897000 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe54bff-5469-4260-8fcc-1c2dc31644eb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:01.897304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe54bff-5469-4260-8fcc-1c2dc31644eb None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.898006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe54bff-5469-4260-8fcc-1c2dc31644eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:01.898306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe54bff-5469-4260-8fcc-1c2dc31644eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:01.899727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe54bff-5469-4260-8fcc-1c2dc31644eb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:01.907692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 43/84] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:01.908503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe54bff-5469-4260-8fcc-1c2dc31644eb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.918146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d8cc7-f49b-4053-a691-a64622917236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:01.918819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8cc7-f49b-4053-a691-a64622917236 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:01.919097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8cc7-f49b-4053-a691-a64622917236 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:01.919361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8cc7-f49b-4053-a691-a64622917236 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:01.920516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d8cc7-f49b-4053-a691-a64622917236 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:01.921973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d8cc7-f49b-4053-a691-a64622917236 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:01.923847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 42/85] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:01 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:01.927595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d8cc7-f49b-4053-a691-a64622917236 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:01.958131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:02.016826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe54bff-5469-4260-8fcc-1c2dc31644eb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:02.029518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d8cc7-f49b-4053-a691-a64622917236 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:02.050932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04ecb3-2541-4a38-998a-d950ff2b3269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:02.051578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04ecb3-2541-4a38-998a-d950ff2b3269 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:02.052354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04ecb3-2541-4a38-998a-d950ff2b3269 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:02.052732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04ecb3-2541-4a38-998a-d950ff2b3269 None admin] PATH_INFO: `/v3/users/b81582df34a44b238abda1fb4c41a74a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:02.053938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04ecb3-2541-4a38-998a-d950ff2b3269 None admin] RBAC: Authorizing `identity:get_user(user_id=b81582df34a44b238abda1fb4c41a74a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:02.055444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04ecb3-2541-4a38-998a-d950ff2b3269 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:02.057093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 44/86] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:01 2022] GET /identity/v3/users/b81582df34a44b238abda1fb4c41a74a => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:02.057867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04ecb3-2541-4a38-998a-d950ff2b3269 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:02.065248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:02.072350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66728e-8bd6-49c6-8e83-1d1b0c7bcff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:02.073334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66728e-8bd6-49c6-8e83-1d1b0c7bcff2 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:02.073610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66728e-8bd6-49c6-8e83-1d1b0c7bcff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:02.073878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66728e-8bd6-49c6-8e83-1d1b0c7bcff2 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:02.074539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66728e-8bd6-49c6-8e83-1d1b0c7bcff2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:02.076066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66728e-8bd6-49c6-8e83-1d1b0c7bcff2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:02.105835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 43/87] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:01 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:02.106785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66728e-8bd6-49c6-8e83-1d1b0c7bcff2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:02.173253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04ecb3-2541-4a38-998a-d950ff2b3269 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:02.193954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:02.221540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae3ba6-c4fd-4e1a-b6cd-d5be78f6d852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:02.222215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae3ba6-c4fd-4e1a-b6cd-d5be78f6d852 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:02.222545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae3ba6-c4fd-4e1a-b6cd-d5be78f6d852 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:02.222866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae3ba6-c4fd-4e1a-b6cd-d5be78f6d852 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:02.223170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66728e-8bd6-49c6-8e83-1d1b0c7bcff2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:02.224094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae3ba6-c4fd-4e1a-b6cd-d5be78f6d852 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:02.227152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae3ba6-c4fd-4e1a-b6cd-d5be78f6d852 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:02.234286 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 45/88] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:02 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:02.234286 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae3ba6-c4fd-4e1a-b6cd-d5be78f6d852 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:02.266172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda3635-1608-4204-9f58-a876cf591be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:02.266858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda3635-1608-4204-9f58-a876cf591be0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:02.267140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda3635-1608-4204-9f58-a876cf591be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:02.268214 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda3635-1608-4204-9f58-a876cf591be0 None admin] PATH_INFO: `/v3/users/b81582df34a44b238abda1fb4c41a74a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:02.269846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda3635-1608-4204-9f58-a876cf591be0 None admin] RBAC: Authorizing `identity:get_user(user_id=b81582df34a44b238abda1fb4c41a74a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:02.271399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda3635-1608-4204-9f58-a876cf591be0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:02.273456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 44/89] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:02 2022] GET /identity/v3/users/b81582df34a44b238abda1fb4c41a74a => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:02.274066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda3635-1608-4204-9f58-a876cf591be0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:02.335069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:02.352428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae3ba6-c4fd-4e1a-b6cd-d5be78f6d852 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:02.388497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda3635-1608-4204-9f58-a876cf591be0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:02.394737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319ecff-e2b1-412c-a3e8-daf06f1d310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:02.395373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319ecff-e2b1-412c-a3e8-daf06f1d310f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:02.395653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319ecff-e2b1-412c-a3e8-daf06f1d310f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:02.395930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319ecff-e2b1-412c-a3e8-daf06f1d310f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:02.396795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319ecff-e2b1-412c-a3e8-daf06f1d310f None admin] RBAC: Adding query filter params (role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=5155bcda0dce418e98bae20b53135115, user.id=b81582df34a44b238abda1fb4c41a74a) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:02.397686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319ecff-e2b1-412c-a3e8-daf06f1d310f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:02.399261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319ecff-e2b1-412c-a3e8-daf06f1d310f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:02.406905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 46/90] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:02 2022] GET /identity/v3/role_assignments?user.id=b81582df34a44b238abda1fb4c41a74a&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:02.408436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319ecff-e2b1-412c-a3e8-daf06f1d310f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:02.446960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2a506-4680-4b7f-9073-3a1b5b050d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:02.448447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2a506-4680-4b7f-9073-3a1b5b050d17 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:02.449031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2a506-4680-4b7f-9073-3a1b5b050d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:02.449468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2a506-4680-4b7f-9073-3a1b5b050d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:02.485778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:02.552938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2a506-4680-4b7f-9073-3a1b5b050d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:02.555004 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2a506-4680-4b7f-9073-3a1b5b050d17 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:02.559747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319ecff-e2b1-412c-a3e8-daf06f1d310f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:02.599805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c549d8-7c4a-4fdf-98bb-cfe60c7834a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:02.600890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c549d8-7c4a-4fdf-98bb-cfe60c7834a5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:02.601362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c549d8-7c4a-4fdf-98bb-cfe60c7834a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:02.601841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c549d8-7c4a-4fdf-98bb-cfe60c7834a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:02.602923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c549d8-7c4a-4fdf-98bb-cfe60c7834a5 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=5155bcda0dce418e98bae20b53135115, user.id=4cd618c84674445b8b18062be3eac4f8) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:02.603437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c549d8-7c4a-4fdf-98bb-cfe60c7834a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:02.605272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c549d8-7c4a-4fdf-98bb-cfe60c7834a5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:02.612125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 47/91] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:02 2022] GET /identity/v3/role_assignments?user.id=4cd618c84674445b8b18062be3eac4f8&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:02.613317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c549d8-7c4a-4fdf-98bb-cfe60c7834a5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:02.619008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:02.706620 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 45/92] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:02.727592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2a506-4680-4b7f-9073-3a1b5b050d17 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:02.752673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c549d8-7c4a-4fdf-98bb-cfe60c7834a5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:02.768458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:02.798158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c502850-6808-4016-a5cd-d37eed7b6acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:02.798928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c502850-6808-4016-a5cd-d37eed7b6acd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:02.799252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c502850-6808-4016-a5cd-d37eed7b6acd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:02.799530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c502850-6808-4016-a5cd-d37eed7b6acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:02.934675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2a506-4680-4b7f-9073-3a1b5b050d17 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:02.955686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c502850-6808-4016-a5cd-d37eed7b6acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:02.957024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c502850-6808-4016-a5cd-d37eed7b6acd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:02.985284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848c29f-c485-4788-a018-81c4990bf035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:02.986770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848c29f-c485-4788-a018-81c4990bf035 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:02.987296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848c29f-c485-4788-a018-81c4990bf035 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:02.987772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848c29f-c485-4788-a018-81c4990bf035 None admin] PATH_INFO: `/v3/projects/a6a93a7a6ded46579442b8edfab10224` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:02.990088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848c29f-c485-4788-a018-81c4990bf035 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a93a7a6ded46579442b8edfab10224)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:02.992044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848c29f-c485-4788-a018-81c4990bf035 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:02.994287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 46/93] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:02 2022] GET /identity/v3/projects/a6a93a7a6ded46579442b8edfab10224 => generated 312 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:03.004448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848c29f-c485-4788-a018-81c4990bf035 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:03.058909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:03.180515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 48/94] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:03.186305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c502850-6808-4016-a5cd-d37eed7b6acd None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:03.208100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:03.240904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848c29f-c485-4788-a018-81c4990bf035 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:03.302121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051c137-b500-45f5-8621-21c7770e95b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:03.302861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051c137-b500-45f5-8621-21c7770e95b4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:03.303146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051c137-b500-45f5-8621-21c7770e95b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:03.303426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051c137-b500-45f5-8621-21c7770e95b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:03.304189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051c137-b500-45f5-8621-21c7770e95b4 None admin] RBAC: Adding query filter params (role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=a6a93a7a6ded46579442b8edfab10224, user.id=b81582df34a44b238abda1fb4c41a74a) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:03.304502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051c137-b500-45f5-8621-21c7770e95b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:03.305993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051c137-b500-45f5-8621-21c7770e95b4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:03.322574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 47/95] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:03 2022] GET /identity/v3/role_assignments?user.id=b81582df34a44b238abda1fb4c41a74a&scope.project.id=a6a93a7a6ded46579442b8edfab10224&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:03.370734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c502850-6808-4016-a5cd-d37eed7b6acd None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:03.412383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617428f6-0faf-481c-8056-5e2f15abd953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:03.413049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617428f6-0faf-481c-8056-5e2f15abd953 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:03.413335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617428f6-0faf-481c-8056-5e2f15abd953 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:03.413615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617428f6-0faf-481c-8056-5e2f15abd953 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:03.414845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617428f6-0faf-481c-8056-5e2f15abd953 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:03.416347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617428f6-0faf-481c-8056-5e2f15abd953 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:03.418506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 49/96] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:03 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:03.424185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051c137-b500-45f5-8621-21c7770e95b4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:03.551731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:03.574098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051c137-b500-45f5-8621-21c7770e95b4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:03.622247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792d612-8205-4bb2-91fe-b89ac9d03192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:03.622914 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d612-8205-4bb2-91fe-b89ac9d03192 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:03.623197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d612-8205-4bb2-91fe-b89ac9d03192 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:03.623470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d612-8205-4bb2-91fe-b89ac9d03192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:03.624235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792d612-8205-4bb2-91fe-b89ac9d03192 None admin] RBAC: Adding query filter params (role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=5155bcda0dce418e98bae20b53135115, user.id=b81582df34a44b238abda1fb4c41a74a) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:03.624546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792d612-8205-4bb2-91fe-b89ac9d03192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:03.626047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792d612-8205-4bb2-91fe-b89ac9d03192 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:03.637790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 48/97] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:03 2022] GET /identity/v3/role_assignments?user.id=b81582df34a44b238abda1fb4c41a74a&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=2e42b82a17a84744960aa3904ab682cc => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:04.840400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecfc37-da22-424f-8baf-1e95eff3f553 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:04.841021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecfc37-da22-424f-8baf-1e95eff3f553 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:04.841021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecfc37-da22-424f-8baf-1e95eff3f553 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:04.842400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 50/98] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:04.848015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1996fb-29bd-4dc8-82fc-4e27536ce2df None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:04.848460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1996fb-29bd-4dc8-82fc-4e27536ce2df None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:04.848638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1996fb-29bd-4dc8-82fc-4e27536ce2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:04.873251 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-db1996fb-29bd-4dc8-82fc-4e27536ce2df None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:04.874447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-db1996fb-29bd-4dc8-82fc-4e27536ce2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:04.962640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 49/99] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:05.114259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4945a8-7dd8-40c7-a91e-1c57a864ac6c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:05.114602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4945a8-7dd8-40c7-a91e-1c57a864ac6c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:05.114957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4945a8-7dd8-40c7-a91e-1c57a864ac6c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:05.116744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 51/100] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:05.123128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972bbf2-1b8c-4878-a953-f890c27e76c0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:05.123473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972bbf2-1b8c-4878-a953-f890c27e76c0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:05.123698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972bbf2-1b8c-4878-a953-f890c27e76c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:05.151698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0972bbf2-1b8c-4878-a953-f890c27e76c0 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:05.152939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0972bbf2-1b8c-4878-a953-f890c27e76c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:05.236254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 50/101] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:05.453196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4945a8-7dd8-40c7-a91e-1c57a864ac6c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:05.546942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:05.568161 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4945a8-7dd8-40c7-a91e-1c57a864ac6c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:05.609607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f99b4-314f-4e35-af31-adda42af1755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:05.610267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f99b4-314f-4e35-af31-adda42af1755 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:05.610548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f99b4-314f-4e35-af31-adda42af1755 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:05.610853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f99b4-314f-4e35-af31-adda42af1755 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:05.612117 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f99b4-314f-4e35-af31-adda42af1755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:05.616510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f99b4-314f-4e35-af31-adda42af1755 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:05.616510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 52/102] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:05.621348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972bbf2-1b8c-4878-a953-f890c27e76c0 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:05.634202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:05.752589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972bbf2-1b8c-4878-a953-f890c27e76c0 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:05.799367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6369e-530f-45b6-9bee-4a28af25cb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:05.800334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6369e-530f-45b6-9bee-4a28af25cb62 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:05.800799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6369e-530f-45b6-9bee-4a28af25cb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:05.801287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6369e-530f-45b6-9bee-4a28af25cb62 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:05.802115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6369e-530f-45b6-9bee-4a28af25cb62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:05.804172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6369e-530f-45b6-9bee-4a28af25cb62 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:05.843742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 51/103] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:18:05 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:05.889235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f99b4-314f-4e35-af31-adda42af1755 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:06.012944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f99b4-314f-4e35-af31-adda42af1755 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:06.047682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eedde-bb19-4293-900f-63cdfeb6db88 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.049164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eedde-bb19-4293-900f-63cdfeb6db88 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.050458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eedde-bb19-4293-900f-63cdfeb6db88 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.053603 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 52/104] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:06.059390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da0861-fe10-4c26-9f70-9cd46ffb23f8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.059955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da0861-fe10-4c26-9f70-9cd46ffb23f8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.060447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da0861-fe10-4c26-9f70-9cd46ffb23f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.062250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac49c8-deab-4cdf-8a61-2455bfeb0ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:06.062984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac49c8-deab-4cdf-8a61-2455bfeb0ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.063263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac49c8-deab-4cdf-8a61-2455bfeb0ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.063532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac49c8-deab-4cdf-8a61-2455bfeb0ed9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.084753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac49c8-deab-4cdf-8a61-2455bfeb0ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:06.086470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-53da0861-fe10-4c26-9f70-9cd46ffb23f8 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:06.087831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-53da0861-fe10-4c26-9f70-9cd46ffb23f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-dfac49c8-deab-4cdf-8a61-2455bfeb0ed9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:06.090809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:06.091665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:06.092437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:06.098773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 53/105] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:06.100574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffb60e-2622-4da3-ac07-9576b286021f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.101050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffb60e-2622-4da3-ac07-9576b286021f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.101332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffb60e-2622-4da3-ac07-9576b286021f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.102900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 54/106] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:06.105325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1bd9d-0747-48c6-a92d-8624d12fdb16 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.105640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1bd9d-0747-48c6-a92d-8624d12fdb16 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.106413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1bd9d-0747-48c6-a92d-8624d12fdb16 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.108591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 55/107] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:06.109303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1bd9d-0747-48c6-a92d-8624d12fdb16 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:06.121065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:06.164418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:06.180443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 53/108] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:06.181776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed75358-8278-442f-9cdd-be8bc51c741a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.182107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed75358-8278-442f-9cdd-be8bc51c741a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.182385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed75358-8278-442f-9cdd-be8bc51c741a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.212713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bed75358-8278-442f-9cdd-be8bc51c741a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:06.214447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bed75358-8278-442f-9cdd-be8bc51c741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:06.258050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1bd9d-0747-48c6-a92d-8624d12fdb16 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:06.327078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005bba8-f919-42d2-811c-4b7a1f9557e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:06.329211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005bba8-f919-42d2-811c-4b7a1f9557e6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.330412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005bba8-f919-42d2-811c-4b7a1f9557e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.330912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005bba8-f919-42d2-811c-4b7a1f9557e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.331892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005bba8-f919-42d2-811c-4b7a1f9557e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:06.332985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005bba8-f919-42d2-811c-4b7a1f9557e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:06.336190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005bba8-f919-42d2-811c-4b7a1f9557e6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:06.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 54/109] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:06.342794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e821e-a5c3-45fa-b9d7-6431da97c9f3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.343537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e821e-a5c3-45fa-b9d7-6431da97c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.344846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e821e-a5c3-45fa-b9d7-6431da97c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.355854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 56/110] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:06.364129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005bba8-f919-42d2-811c-4b7a1f9557e6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:06.387883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a24e821e-a5c3-45fa-b9d7-6431da97c9f3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:06.389457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a24e821e-a5c3-45fa-b9d7-6431da97c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:06.506059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:06.507343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 55/111] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:06.509885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e821e-a5c3-45fa-b9d7-6431da97c9f3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:06.567660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:06.577398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005bba8-f919-42d2-811c-4b7a1f9557e6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:06.619946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e821e-a5c3-45fa-b9d7-6431da97c9f3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:06.664222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b126c52-4fee-4f8d-b5e5-90b212ccd2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:06.665395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b126c52-4fee-4f8d-b5e5-90b212ccd2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.666945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b126c52-4fee-4f8d-b5e5-90b212ccd2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.667614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b126c52-4fee-4f8d-b5e5-90b212ccd2a9 None admin] PATH_INFO: `/v3/users/e14deaf49b804728bc5b64508db33dfb` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.681854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0867d9-a868-485f-91f7-fb9427191152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:06.683018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0867d9-a868-485f-91f7-fb9427191152 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.683552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0867d9-a868-485f-91f7-fb9427191152 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.684038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0867d9-a868-485f-91f7-fb9427191152 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.698947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b126c52-4fee-4f8d-b5e5-90b212ccd2a9 None admin] RBAC: Authorizing `identity:get_user(user_id=e14deaf49b804728bc5b64508db33dfb)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:06.703536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b126c52-4fee-4f8d-b5e5-90b212ccd2a9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:06.705638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 57/112] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:06 2022] GET /identity/v3/users/e14deaf49b804728bc5b64508db33dfb => generated 289 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:06.713581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0867d9-a868-485f-91f7-fb9427191152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:06.716896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096bc8b-40a0-49f9-a918-d1467ed17062 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.717384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096bc8b-40a0-49f9-a918-d1467ed17062 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.717876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096bc8b-40a0-49f9-a918-d1467ed17062 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8b0867d9-a868-485f-91f7-fb9427191152 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:06.721245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:06.722063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:06.722853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:06.724220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 58/113] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:06.725724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096bc8b-40a0-49f9-a918-d1467ed17062 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:06.727975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 56/114] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:06.732044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74717e-72f7-4d32-86e8-e7d335dc02e4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.732727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74717e-72f7-4d32-86e8-e7d335dc02e4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.734065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74717e-72f7-4d32-86e8-e7d335dc02e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.767231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8d74717e-72f7-4d32-86e8-e7d335dc02e4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:06.769349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8d74717e-72f7-4d32-86e8-e7d335dc02e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:06.864289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 57/115] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:06.865838 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74717e-72f7-4d32-86e8-e7d335dc02e4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:06.875271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096bc8b-40a0-49f9-a918-d1467ed17062 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:06.915753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:06.918930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:06.930561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89280d-cef6-4ef3-99fb-934d37878266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:06.931551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89280d-cef6-4ef3-99fb-934d37878266 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:06.932002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89280d-cef6-4ef3-99fb-934d37878266 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:06.932436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89280d-cef6-4ef3-99fb-934d37878266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:06.991974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74717e-72f7-4d32-86e8-e7d335dc02e4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.027105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89280d-cef6-4ef3-99fb-934d37878266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:07.029109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89280d-cef6-4ef3-99fb-934d37878266 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:07.031755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c8861-2ef0-4e48-b831-c439a9256005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.032964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8861-2ef0-4e48-b831-c439a9256005 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.032964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8861-2ef0-4e48-b831-c439a9256005 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.033309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8861-2ef0-4e48-b831-c439a9256005 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.034094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c8861-2ef0-4e48-b831-c439a9256005 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:07.034489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c8861-2ef0-4e48-b831-c439a9256005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:07.036006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c8861-2ef0-4e48-b831-c439a9256005 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:07.047336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 58/116] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:07.053369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c8861-2ef0-4e48-b831-c439a9256005 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.167239 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 59/117] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:07.168034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89280d-cef6-4ef3-99fb-934d37878266 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.172819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c8861-2ef0-4e48-b831-c439a9256005 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.177910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:07.203075 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:07.216926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf030a94-ac25-4101-9446-b86e1c4b756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.217588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf030a94-ac25-4101-9446-b86e1c4b756f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.217862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf030a94-ac25-4101-9446-b86e1c4b756f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.218130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf030a94-ac25-4101-9446-b86e1c4b756f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.231343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf030a94-ac25-4101-9446-b86e1c4b756f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-bf030a94-ac25-4101-9446-b86e1c4b756f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:07.236370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:07.237306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:07.238063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 59/118] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:07.239326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf030a94-ac25-4101-9446-b86e1c4b756f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.296226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89280d-cef6-4ef3-99fb-934d37878266 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.336593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b9881-038a-4bf3-aed1-78e6bf7554cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.337245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b9881-038a-4bf3-aed1-78e6bf7554cb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.337528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b9881-038a-4bf3-aed1-78e6bf7554cb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.337800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b9881-038a-4bf3-aed1-78e6bf7554cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.353070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b9881-038a-4bf3-aed1-78e6bf7554cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:07.357188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf030a94-ac25-4101-9446-b86e1c4b756f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-de5b9881-038a-4bf3-aed1-78e6bf7554cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:07.357781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:07.358574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:07.359354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 60/119] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:07.360018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b9881-038a-4bf3-aed1-78e6bf7554cb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.405162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67447e91-8d65-44a6-8746-0a1d34173dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.405921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67447e91-8d65-44a6-8746-0a1d34173dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.406280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67447e91-8d65-44a6-8746-0a1d34173dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.406560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67447e91-8d65-44a6-8746-0a1d34173dd1 None admin] PATH_INFO: `/v3/users/b81582df34a44b238abda1fb4c41a74a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.407754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67447e91-8d65-44a6-8746-0a1d34173dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=b81582df34a44b238abda1fb4c41a74a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:07.409216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67447e91-8d65-44a6-8746-0a1d34173dd1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:07.410856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 60/120] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/users/b81582df34a44b238abda1fb4c41a74a => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:07.411630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67447e91-8d65-44a6-8746-0a1d34173dd1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.451352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:07.485720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:07.499985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b9881-038a-4bf3-aed1-78e6bf7554cb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.538364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67447e91-8d65-44a6-8746-0a1d34173dd1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.544676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793af8-2b7b-4c11-8744-6fa1a7b80534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.545350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793af8-2b7b-4c11-8744-6fa1a7b80534 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.545634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793af8-2b7b-4c11-8744-6fa1a7b80534 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.545909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793af8-2b7b-4c11-8744-6fa1a7b80534 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.565528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793af8-2b7b-4c11-8744-6fa1a7b80534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-79793af8-2b7b-4c11-8744-6fa1a7b80534 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:07.569061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:07.569947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:07.571861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 61/121] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:07.572527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793af8-2b7b-4c11-8744-6fa1a7b80534 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.592270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b9f3f-0f8d-4c7d-8a22-c3326dcf47ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.592930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9f3f-0f8d-4c7d-8a22-c3326dcf47ce None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.593213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9f3f-0f8d-4c7d-8a22-c3326dcf47ce None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.593491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9f3f-0f8d-4c7d-8a22-c3326dcf47ce None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.594741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b9f3f-0f8d-4c7d-8a22-c3326dcf47ce None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:07.596252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b9f3f-0f8d-4c7d-8a22-c3326dcf47ce None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:07.598152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 61/122] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:07.598763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b9f3f-0f8d-4c7d-8a22-c3326dcf47ce None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.703221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793af8-2b7b-4c11-8744-6fa1a7b80534 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.721685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:07.727331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b9f3f-0f8d-4c7d-8a22-c3326dcf47ce None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.743021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e152fb-c78d-4db8-a939-2c3ab99ffdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.743948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e152fb-c78d-4db8-a939-2c3ab99ffdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.744062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e152fb-c78d-4db8-a939-2c3ab99ffdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.744470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e152fb-c78d-4db8-a939-2c3ab99ffdf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.745046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e152fb-c78d-4db8-a939-2c3ab99ffdf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:07.745357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e152fb-c78d-4db8-a939-2c3ab99ffdf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:07.746785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e152fb-c78d-4db8-a939-2c3ab99ffdf7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:07.765705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 62/123] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:07.765705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e152fb-c78d-4db8-a939-2c3ab99ffdf7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.779151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:07.785445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e9fd8-d7b1-42cc-aa69-c2e0ac226c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.786079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e9fd8-d7b1-42cc-aa69-c2e0ac226c5b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.786421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e9fd8-d7b1-42cc-aa69-c2e0ac226c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.786628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e9fd8-d7b1-42cc-aa69-c2e0ac226c5b None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.788066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e9fd8-d7b1-42cc-aa69-c2e0ac226c5b None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:07.788384 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e9fd8-d7b1-42cc-aa69-c2e0ac226c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:07.789794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e9fd8-d7b1-42cc-aa69-c2e0ac226c5b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:07.800661 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 62/124] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:07.801628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e9fd8-d7b1-42cc-aa69-c2e0ac226c5b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.893434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e152fb-c78d-4db8-a939-2c3ab99ffdf7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.934940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e9fd8-d7b1-42cc-aa69-c2e0ac226c5b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:07.939669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81598b5a-28f3-465d-829f-ed1b9dbe6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.940326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81598b5a-28f3-465d-829f-ed1b9dbe6989 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.940605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81598b5a-28f3-465d-829f-ed1b9dbe6989 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.941223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81598b5a-28f3-465d-829f-ed1b9dbe6989 None admin] PATH_INFO: `/v3/projects/a6a93a7a6ded46579442b8edfab10224` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.942401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81598b5a-28f3-465d-829f-ed1b9dbe6989 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a93a7a6ded46579442b8edfab10224)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:07.944864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81598b5a-28f3-465d-829f-ed1b9dbe6989 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:07.952172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 63/125] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/projects/a6a93a7a6ded46579442b8edfab10224 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:07.952172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81598b5a-28f3-465d-829f-ed1b9dbe6989 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:07.991253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54bfd7-7a5c-4438-8268-cbc70193e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:07.991834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54bfd7-7a5c-4438-8268-cbc70193e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:07.992166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54bfd7-7a5c-4438-8268-cbc70193e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:07.992441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54bfd7-7a5c-4438-8268-cbc70193e2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:07.993135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54bfd7-7a5c-4438-8268-cbc70193e2c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:07.993440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54bfd7-7a5c-4438-8268-cbc70193e2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:07.994877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54bfd7-7a5c-4438-8268-cbc70193e2c9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:08.004930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 63/126] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:08.007783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54bfd7-7a5c-4438-8268-cbc70193e2c9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:08.042063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:08.057069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:08.080253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81598b5a-28f3-465d-829f-ed1b9dbe6989 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:08.118392 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ab3c-784f-429d-b943-8c1e894de1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:08.119055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ab3c-784f-429d-b943-8c1e894de1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:08.119335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ab3c-784f-429d-b943-8c1e894de1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:08.119612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ab3c-784f-429d-b943-8c1e894de1b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:08.120351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7ab3c-784f-429d-b943-8c1e894de1b2 None admin] RBAC: Adding query filter params (role.id=df51cbf6777f4f5990a32ae5d5c1ce0e, scope.project.id=5155bcda0dce418e98bae20b53135115, user.id=e14deaf49b804728bc5b64508db33dfb) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:08.120664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7ab3c-784f-429d-b943-8c1e894de1b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:08.122162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7ab3c-784f-429d-b943-8c1e894de1b2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:08.127755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 64/127] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:07 2022] GET /identity/v3/role_assignments?user.id=e14deaf49b804728bc5b64508db33dfb&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=df51cbf6777f4f5990a32ae5d5c1ce0e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:08.128573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ab3c-784f-429d-b943-8c1e894de1b2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:08.131882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54bfd7-7a5c-4438-8268-cbc70193e2c9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:08.184866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2902f1-675e-487d-bfcc-6a763cdc5378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:08.185695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2902f1-675e-487d-bfcc-6a763cdc5378 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:08.186034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2902f1-675e-487d-bfcc-6a763cdc5378 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:08.186360 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2902f1-675e-487d-bfcc-6a763cdc5378 None admin] PATH_INFO: `/v3/users/4cd618c84674445b8b18062be3eac4f8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:08.188453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2902f1-675e-487d-bfcc-6a763cdc5378 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd618c84674445b8b18062be3eac4f8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:08.190495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2902f1-675e-487d-bfcc-6a763cdc5378 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:08.192546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 64/128] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:08 2022] GET /identity/v3/users/4cd618c84674445b8b18062be3eac4f8 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:08.193399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2902f1-675e-487d-bfcc-6a763cdc5378 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:08.275360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ab3c-784f-429d-b943-8c1e894de1b2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:08.320249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7f351-af46-47db-b108-321f9f237082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:08.321302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f351-af46-47db-b108-321f9f237082 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:08.321587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f351-af46-47db-b108-321f9f237082 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:08.321857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f351-af46-47db-b108-321f9f237082 None admin] PATH_INFO: `/v3/users/b81582df34a44b238abda1fb4c41a74a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:08.323507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7f351-af46-47db-b108-321f9f237082 None admin] RBAC: Authorizing `identity:get_user(user_id=b81582df34a44b238abda1fb4c41a74a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:08.325096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7f351-af46-47db-b108-321f9f237082 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:08.327062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 65/129] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:08 2022] GET /identity/v3/users/b81582df34a44b238abda1fb4c41a74a => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:08.327973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7f351-af46-47db-b108-321f9f237082 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:08.338644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:08.344063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:08.353283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2902f1-675e-487d-bfcc-6a763cdc5378 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:08.403119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847cec4-7dac-4296-bf5f-780b9e55e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:08.404105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847cec4-7dac-4296-bf5f-780b9e55e19a None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:08.404555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847cec4-7dac-4296-bf5f-780b9e55e19a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:08.405008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847cec4-7dac-4296-bf5f-780b9e55e19a None admin] PATH_INFO: `/v3/projects/a6a93a7a6ded46579442b8edfab10224/users/b81582df34a44b238abda1fb4c41a74a/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:08.408102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847cec4-7dac-4296-bf5f-780b9e55e19a None admin] RBAC: Authorizing `identity:create_grant(project_id=a6a93a7a6ded46579442b8edfab10224, user_id=b81582df34a44b238abda1fb4c41a74a, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:08.410238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847cec4-7dac-4296-bf5f-780b9e55e19a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:08.432078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 65/130] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:18:08 2022] PUT /identity/v3/projects/a6a93a7a6ded46579442b8edfab10224/users/b81582df34a44b238abda1fb4c41a74a/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:08.434004 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fe9be-07db-409a-86af-2cc49a059da9 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:08.434522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fe9be-07db-409a-86af-2cc49a059da9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:08.435031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fe9be-07db-409a-86af-2cc49a059da9 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:08.437700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 66/131] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:08.438695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fe9be-07db-409a-86af-2cc49a059da9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:08.520790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7f351-af46-47db-b108-321f9f237082 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:08.578526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072130d5-a2b4-4005-a4af-bbcbf6a82bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:08.579577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072130d5-a2b4-4005-a4af-bbcbf6a82bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:08.580029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072130d5-a2b4-4005-a4af-bbcbf6a82bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:08.580480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072130d5-a2b4-4005-a4af-bbcbf6a82bf8 None admin] PATH_INFO: `/v3/users/b81582df34a44b238abda1fb4c41a74a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:08.582545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072130d5-a2b4-4005-a4af-bbcbf6a82bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=b81582df34a44b238abda1fb4c41a74a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:08.585389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072130d5-a2b4-4005-a4af-bbcbf6a82bf8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:08.603313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 66/132] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:08 2022] GET /identity/v3/users/b81582df34a44b238abda1fb4c41a74a => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:08.604861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072130d5-a2b4-4005-a4af-bbcbf6a82bf8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:08.607572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fe9be-07db-409a-86af-2cc49a059da9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:08.653840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194974e-be47-442f-b23c-c9a113c18a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:08.654674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194974e-be47-442f-b23c-c9a113c18a4a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:08.655053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194974e-be47-442f-b23c-c9a113c18a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:08.655417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194974e-be47-442f-b23c-c9a113c18a4a None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:08.656710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194974e-be47-442f-b23c-c9a113c18a4a None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:08.658308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194974e-be47-442f-b23c-c9a113c18a4a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:08.660929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 67/133] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:08 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:08.662424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a48af-bbfd-4cf4-9154-3a154b58ac35 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:08.662830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a48af-bbfd-4cf4-9154-3a154b58ac35 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:08.663274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a48af-bbfd-4cf4-9154-3a154b58ac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:08.688139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2f4a48af-bbfd-4cf4-9154-3a154b58ac35 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:08.689595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2f4a48af-bbfd-4cf4-9154-3a154b58ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:08.710723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:08.768568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:08.795333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 68/134] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:08.796409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a48af-bbfd-4cf4-9154-3a154b58ac35 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:08.810789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072130d5-a2b4-4005-a4af-bbcbf6a82bf8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:08.902814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99bb13-43f4-45ec-9fc0-a851c93f4626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:08.904196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99bb13-43f4-45ec-9fc0-a851c93f4626 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:08.904398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99bb13-43f4-45ec-9fc0-a851c93f4626 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:08.907857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99bb13-43f4-45ec-9fc0-a851c93f4626 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:08.907857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99bb13-43f4-45ec-9fc0-a851c93f4626 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:08.909764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99bb13-43f4-45ec-9fc0-a851c93f4626 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:08.921535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 67/135] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:08 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:08.923003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99bb13-43f4-45ec-9fc0-a851c93f4626 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:09.037025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a48af-bbfd-4cf4-9154-3a154b58ac35 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:09.140950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd3d1b-7183-4bcf-b0db-14cd17d73467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:09.141810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd3d1b-7183-4bcf-b0db-14cd17d73467 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:09.141930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd3d1b-7183-4bcf-b0db-14cd17d73467 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:09.142369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd3d1b-7183-4bcf-b0db-14cd17d73467 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:09.145945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd3d1b-7183-4bcf-b0db-14cd17d73467 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:09.147962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd3d1b-7183-4bcf-b0db-14cd17d73467 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:09.150077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 69/136] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:08 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:09.150897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd3d1b-7183-4bcf-b0db-14cd17d73467 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:09.155797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99bb13-43f4-45ec-9fc0-a851c93f4626 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:09.205403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:09.233573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aee19-90e1-4305-9ec0-3a95e225f07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:09.234754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aee19-90e1-4305-9ec0-3a95e225f07b None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:09.235257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aee19-90e1-4305-9ec0-3a95e225f07b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:09.235750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aee19-90e1-4305-9ec0-3a95e225f07b None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115/users/4cd618c84674445b8b18062be3eac4f8/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:09.240328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aee19-90e1-4305-9ec0-3a95e225f07b None admin] RBAC: Authorizing `identity:create_grant(project_id=5155bcda0dce418e98bae20b53135115, user_id=4cd618c84674445b8b18062be3eac4f8, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:09.243126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aee19-90e1-4305-9ec0-3a95e225f07b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:09.282472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 68/137] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:18:08 2022] PUT /identity/v3/projects/5155bcda0dce418e98bae20b53135115/users/4cd618c84674445b8b18062be3eac4f8/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:09.285215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aee19-90e1-4305-9ec0-3a95e225f07b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:09.320065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:09.340411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd3d1b-7183-4bcf-b0db-14cd17d73467 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:09.398105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc977f-cb50-4ee8-abb5-2d3144f0f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:09.398857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc977f-cb50-4ee8-abb5-2d3144f0f4a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:09.399142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc977f-cb50-4ee8-abb5-2d3144f0f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:09.399416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc977f-cb50-4ee8-abb5-2d3144f0f4a5 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115/users/b81582df34a44b238abda1fb4c41a74a/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:09.402246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc977f-cb50-4ee8-abb5-2d3144f0f4a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5155bcda0dce418e98bae20b53135115, user_id=b81582df34a44b238abda1fb4c41a74a, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:09.404207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc977f-cb50-4ee8-abb5-2d3144f0f4a5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:09.435603 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 70/138] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:18:09 2022] PUT /identity/v3/projects/5155bcda0dce418e98bae20b53135115/users/b81582df34a44b238abda1fb4c41a74a/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:09.436912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc977f-cb50-4ee8-abb5-2d3144f0f4a5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:09.551838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aee19-90e1-4305-9ec0-3a95e225f07b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:09.583483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:09.602963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e5ab-5d41-4e66-a453-d7daf54ff80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:09.603663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e5ab-5d41-4e66-a453-d7daf54ff80d None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:09.603949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e5ab-5d41-4e66-a453-d7daf54ff80d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:09.604224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e5ab-5d41-4e66-a453-d7daf54ff80d None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115/users/b81582df34a44b238abda1fb4c41a74a/roles/2e42b82a17a84744960aa3904ab682cc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:09.609859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38e5ab-5d41-4e66-a453-d7daf54ff80d None admin] RBAC: Authorizing `identity:create_grant(project_id=5155bcda0dce418e98bae20b53135115, user_id=b81582df34a44b238abda1fb4c41a74a, role_id=2e42b82a17a84744960aa3904ab682cc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:09.609859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38e5ab-5d41-4e66-a453-d7daf54ff80d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:09.633019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 69/139] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:18:09 2022] PUT /identity/v3/projects/5155bcda0dce418e98bae20b53135115/users/b81582df34a44b238abda1fb4c41a74a/roles/2e42b82a17a84744960aa3904ab682cc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:09.639957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc977f-cb50-4ee8-abb5-2d3144f0f4a5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:09.689352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb972c5-3bd6-4843-a621-f54c29b751cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:09.690022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb972c5-3bd6-4843-a621-f54c29b751cf None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:09.690305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb972c5-3bd6-4843-a621-f54c29b751cf None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:09.690575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb972c5-3bd6-4843-a621-f54c29b751cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:09.692065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb972c5-3bd6-4843-a621-f54c29b751cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:09.694670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb972c5-3bd6-4843-a621-f54c29b751cf None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:09.696659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 71/140] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:09.703220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e5ab-5d41-4e66-a453-d7daf54ff80d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:09.802372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:09.851388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e5ab-5d41-4e66-a453-d7daf54ff80d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:09.894041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc22265-519f-4f03-9524-b655559b4586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:09.894680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc22265-519f-4f03-9524-b655559b4586 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:09.895026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc22265-519f-4f03-9524-b655559b4586 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:09.895302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc22265-519f-4f03-9524-b655559b4586 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:09.895980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc22265-519f-4f03-9524-b655559b4586 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:09.898266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc22265-519f-4f03-9524-b655559b4586 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:09.930762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 70/141] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:09 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:11.117491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383eafe-e462-4135-ab93-c4d3c91150b8 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:11.118424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383eafe-e462-4135-ab93-c4d3c91150b8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:11.118424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383eafe-e462-4135-ab93-c4d3c91150b8 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:11.119518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 72/142] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:11.127594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b748-f5e0-4671-97e6-24a5f7052282 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:11.128364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b748-f5e0-4671-97e6-24a5f7052282 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:11.128364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b748-f5e0-4671-97e6-24a5f7052282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:11.155767 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9ab1b748-f5e0-4671-97e6-24a5f7052282 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:11.157008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9ab1b748-f5e0-4671-97e6-24a5f7052282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:11.244041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 71/143] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:11.902518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1daa7-6f1b-4b7e-acfb-f7a2b6513c03 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:11.902789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1daa7-6f1b-4b7e-acfb-f7a2b6513c03 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:11.903153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1daa7-6f1b-4b7e-acfb-f7a2b6513c03 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:11.904383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 73/144] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:11.910481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3f0b5-43c7-47b3-bc5f-eec521976bd9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:11.910871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3f0b5-43c7-47b3-bc5f-eec521976bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:11.911100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3f0b5-43c7-47b3-bc5f-eec521976bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:11.939821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-19f3f0b5-43c7-47b3-bc5f-eec521976bd9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:11.941081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-19f3f0b5-43c7-47b3-bc5f-eec521976bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:12.017272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:12.045775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 72/145] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:12.070298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01776-6943-4f57-923d-3018be65a033 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:12.070582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01776-6943-4f57-923d-3018be65a033 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:12.070963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01776-6943-4f57-923d-3018be65a033 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:12.072549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 74/146] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:12.092896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d26df-1af5-4851-8a45-d69970aa96a0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:12.093156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d26df-1af5-4851-8a45-d69970aa96a0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:12.093513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d26df-1af5-4851-8a45-d69970aa96a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:12.117280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-967d26df-1af5-4851-8a45-d69970aa96a0 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:12.118565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-967d26df-1af5-4851-8a45-d69970aa96a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:12.171679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01776-6943-4f57-923d-3018be65a033 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:12.280990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 73/147] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:12.487682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01776-6943-4f57-923d-3018be65a033 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:12.562146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc58d8-23d2-408f-9565-674c889a1d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:12.563224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc58d8-23d2-408f-9565-674c889a1d98 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:12.563713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc58d8-23d2-408f-9565-674c889a1d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:12.564196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc58d8-23d2-408f-9565-674c889a1d98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:12.586111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc58d8-23d2-408f-9565-674c889a1d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8dcc58d8-23d2-408f-9565-674c889a1d98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:12.594646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:12.600473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:12.602017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 75/148] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:18:12.607939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d26df-1af5-4851-8a45-d69970aa96a0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:12.634806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc58d8-23d2-408f-9565-674c889a1d98 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:12.651421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:12.847180 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d26df-1af5-4851-8a45-d69970aa96a0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:12.875069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:12.921627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc58d8-23d2-408f-9565-674c889a1d98 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:12.924368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad4b68-f283-4d56-8366-0931da86f2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:12.925070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad4b68-f283-4d56-8366-0931da86f2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:12.925397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad4b68-f283-4d56-8366-0931da86f2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:12.925736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad4b68-f283-4d56-8366-0931da86f2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:12.926422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad4b68-f283-4d56-8366-0931da86f2e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:12.926944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad4b68-f283-4d56-8366-0931da86f2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:12.928520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad4b68-f283-4d56-8366-0931da86f2e4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:12.944646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 74/149] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:12.953749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad4b68-f283-4d56-8366-0931da86f2e4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:12.978006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159ba4c-2aa3-4c7b-84bf-7b694f0ed0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:12.978689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159ba4c-2aa3-4c7b-84bf-7b694f0ed0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:12.978976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159ba4c-2aa3-4c7b-84bf-7b694f0ed0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:12.979253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159ba4c-2aa3-4c7b-84bf-7b694f0ed0d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:13.000643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159ba4c-2aa3-4c7b-84bf-7b694f0ed0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-a159ba4c-2aa3-4c7b-84bf-7b694f0ed0d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:13.010016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:13.011009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:13.011762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 76/150] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:13.038966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159ba4c-2aa3-4c7b-84bf-7b694f0ed0d6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:13.127439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad4b68-f283-4d56-8366-0931da86f2e4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:13.170850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a15a9-6349-477a-b1af-372ce36f38b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:13.171937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a15a9-6349-477a-b1af-372ce36f38b0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:13.172462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a15a9-6349-477a-b1af-372ce36f38b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:13.173003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a15a9-6349-477a-b1af-372ce36f38b0 None admin] PATH_INFO: `/v3/users/e14deaf49b804728bc5b64508db33dfb` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:13.174532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a15a9-6349-477a-b1af-372ce36f38b0 None admin] RBAC: Authorizing `identity:get_user(user_id=e14deaf49b804728bc5b64508db33dfb)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:13.178793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:13.181224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a15a9-6349-477a-b1af-372ce36f38b0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:13.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 75/151] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:12 2022] GET /identity/v3/users/e14deaf49b804728bc5b64508db33dfb => generated 289 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:13.184576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a15a9-6349-477a-b1af-372ce36f38b0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:13.298720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159ba4c-2aa3-4c7b-84bf-7b694f0ed0d6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:13.311257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:13.396431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a2631-bf22-46bd-af28-14a942c31d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:13.397745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a2631-bf22-46bd-af28-14a942c31d8a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:13.398402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a2631-bf22-46bd-af28-14a942c31d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:13.399168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a2631-bf22-46bd-af28-14a942c31d8a None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:13.400257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a2631-bf22-46bd-af28-14a942c31d8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:13.400956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a2631-bf22-46bd-af28-14a942c31d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:13.403450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a2631-bf22-46bd-af28-14a942c31d8a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:13.426604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 77/152] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:13.428531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a2631-bf22-46bd-af28-14a942c31d8a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:13.532717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a15a9-6349-477a-b1af-372ce36f38b0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:13.660646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eccd0-5627-4ef0-bc3b-d6b441c3f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:13.661319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eccd0-5627-4ef0-bc3b-d6b441c3f45e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:13.661760 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eccd0-5627-4ef0-bc3b-d6b441c3f45e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:13.662205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eccd0-5627-4ef0-bc3b-d6b441c3f45e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:13.664150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a2631-bf22-46bd-af28-14a942c31d8a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:13.691444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008eccd0-5627-4ef0-bc3b-d6b441c3f45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-008eccd0-5627-4ef0-bc3b-d6b441c3f45e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:13.697413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:13.698736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:13.699607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 76/153] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 515 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:13.700488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eccd0-5627-4ef0-bc3b-d6b441c3f45e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:13.754357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:13.791669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56157ddb-5bcd-46d7-a8cd-2c1a0f59bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:13.792484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157ddb-5bcd-46d7-a8cd-2c1a0f59bfdf None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:13.792779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157ddb-5bcd-46d7-a8cd-2c1a0f59bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:13.793175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157ddb-5bcd-46d7-a8cd-2c1a0f59bfdf None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:13.794873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56157ddb-5bcd-46d7-a8cd-2c1a0f59bfdf None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:13.796587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56157ddb-5bcd-46d7-a8cd-2c1a0f59bfdf None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:13.798805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 78/154] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:13 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:13.799642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56157ddb-5bcd-46d7-a8cd-2c1a0f59bfdf None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:13.905909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eccd0-5627-4ef0-bc3b-d6b441c3f45e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:13.911204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:13.995242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b9ed3-317d-4fff-bde1-7b5cf0833771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:13.995909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9ed3-317d-4fff-bde1-7b5cf0833771 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:13.996183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9ed3-317d-4fff-bde1-7b5cf0833771 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:13.996455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9ed3-317d-4fff-bde1-7b5cf0833771 None admin] PATH_INFO: `/v3/users/b81582df34a44b238abda1fb4c41a74a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:13.999851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b9ed3-317d-4fff-bde1-7b5cf0833771 None admin] RBAC: Authorizing `identity:get_user(user_id=b81582df34a44b238abda1fb4c41a74a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:14.001401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b9ed3-317d-4fff-bde1-7b5cf0833771 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:14.007550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 77/155] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:13 2022] GET /identity/v3/users/b81582df34a44b238abda1fb4c41a74a => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:14.009010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d32b1-d8f0-4836-9d07-c27f39e682f1 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.009294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d32b1-d8f0-4836-9d07-c27f39e682f1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.009562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d32b1-d8f0-4836-9d07-c27f39e682f1 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.011361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 78/156] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:14.012092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d32b1-d8f0-4836-9d07-c27f39e682f1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:14.058684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56157ddb-5bcd-46d7-a8cd-2c1a0f59bfdf None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:14.126515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a107f-cf23-4468-ae51-47811c6e1675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:14.127643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a107f-cf23-4468-ae51-47811c6e1675 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.128182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a107f-cf23-4468-ae51-47811c6e1675 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.128609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a107f-cf23-4468-ae51-47811c6e1675 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.129577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a107f-cf23-4468-ae51-47811c6e1675 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:14.130122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a107f-cf23-4468-ae51-47811c6e1675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:14.132051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a107f-cf23-4468-ae51-47811c6e1675 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:14.155569 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 79/157] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:14.159713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a107f-cf23-4468-ae51-47811c6e1675 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:14.211861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d32b1-d8f0-4836-9d07-c27f39e682f1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:14.293265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71919c-e994-4269-aaaf-1f3849530b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:14.294220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71919c-e994-4269-aaaf-1f3849530b82 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.294641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71919c-e994-4269-aaaf-1f3849530b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.295067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71919c-e994-4269-aaaf-1f3849530b82 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115/users/e14deaf49b804728bc5b64508db33dfb/roles/df51cbf6777f4f5990a32ae5d5c1ce0e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.298271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71919c-e994-4269-aaaf-1f3849530b82 None admin] RBAC: Authorizing `identity:create_grant(project_id=5155bcda0dce418e98bae20b53135115, user_id=e14deaf49b804728bc5b64508db33dfb, role_id=df51cbf6777f4f5990a32ae5d5c1ce0e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:14.302997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71919c-e994-4269-aaaf-1f3849530b82 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:14.303186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:14.332040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 79/158] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:18:14 2022] PUT /identity/v3/projects/5155bcda0dce418e98bae20b53135115/users/e14deaf49b804728bc5b64508db33dfb/roles/df51cbf6777f4f5990a32ae5d5c1ce0e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:14.337962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e792-5e14-48b1-b050-6fdb3a76d192 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.340006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e792-5e14-48b1-b050-6fdb3a76d192 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.340436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e792-5e14-48b1-b050-6fdb3a76d192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.400113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bee3e792-5e14-48b1-b050-6fdb3a76d192 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:14.402138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bee3e792-5e14-48b1-b050-6fdb3a76d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:14.421511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a107f-cf23-4468-ae51-47811c6e1675 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:14.460038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:14.492983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478383cc-ccca-4846-ac85-57cef789d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:14.494184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478383cc-ccca-4846-ac85-57cef789d025 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.494787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478383cc-ccca-4846-ac85-57cef789d025 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.496120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478383cc-ccca-4846-ac85-57cef789d025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.550684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 80/159] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:14.550684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3e792-5e14-48b1-b050-6fdb3a76d192 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:14.674890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3e792-5e14-48b1-b050-6fdb3a76d192 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:14.680849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478383cc-ccca-4846-ac85-57cef789d025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:14.683020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478383cc-ccca-4846-ac85-57cef789d025 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:14.721374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ded1ca-d276-47e5-8447-819b6c008e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:14.722050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ded1ca-d276-47e5-8447-819b6c008e7b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.722331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ded1ca-d276-47e5-8447-819b6c008e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.722602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ded1ca-d276-47e5-8447-819b6c008e7b None admin] PATH_INFO: `/v3/users/b81582df34a44b238abda1fb4c41a74a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.724067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ded1ca-d276-47e5-8447-819b6c008e7b None admin] RBAC: Authorizing `identity:get_user(user_id=b81582df34a44b238abda1fb4c41a74a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:14.725869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ded1ca-d276-47e5-8447-819b6c008e7b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:14.727675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 81/160] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:14 2022] GET /identity/v3/users/b81582df34a44b238abda1fb4c41a74a => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:14.730785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ecbb-ebfe-4624-9d31-8e11db401e5b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.730785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ecbb-ebfe-4624-9d31-8e11db401e5b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.730785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ecbb-ebfe-4624-9d31-8e11db401e5b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.735644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 82/161] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:14.737040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f802d-b384-497b-b105-015269bfdc94 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.737326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f802d-b384-497b-b105-015269bfdc94 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.737595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f802d-b384-497b-b105-015269bfdc94 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.739320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 83/162] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:14.742552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f802d-b384-497b-b105-015269bfdc94 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:14.778427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:14.824573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:14.869955 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f802d-b384-497b-b105-015269bfdc94 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:14.920731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799133fc-d3ad-4c12-854c-fd9413fbca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:14.921379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799133fc-d3ad-4c12-854c-fd9413fbca78 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.921653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799133fc-d3ad-4c12-854c-fd9413fbca78 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.921928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799133fc-d3ad-4c12-854c-fd9413fbca78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.925983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 80/163] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:14.929024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6d9d-7f1f-4b1a-b227-e52ccc09d9e4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:14.929590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6d9d-7f1f-4b1a-b227-e52ccc09d9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:14.930071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6d9d-7f1f-4b1a-b227-e52ccc09d9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:14.980149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-322a6d9d-7f1f-4b1a-b227-e52ccc09d9e4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:14.981945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-322a6d9d-7f1f-4b1a-b227-e52ccc09d9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:15.005362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799133fc-d3ad-4c12-854c-fd9413fbca78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:15.007555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799133fc-d3ad-4c12-854c-fd9413fbca78 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:15.042138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:15.149490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 81/164] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:15.151046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cacea-1377-4fd7-b1f6-bb8dca9e3f55 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:15.151246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cacea-1377-4fd7-b1f6-bb8dca9e3f55 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:15.151531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cacea-1377-4fd7-b1f6-bb8dca9e3f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:15.183278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 84/165] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:15.184969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799133fc-d3ad-4c12-854c-fd9413fbca78 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:15.217787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fb3cacea-1377-4fd7-b1f6-bb8dca9e3f55 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:15.220669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fb3cacea-1377-4fd7-b1f6-bb8dca9e3f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:15.338176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 82/166] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:15.340469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cacea-1377-4fd7-b1f6-bb8dca9e3f55 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:15.381729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:15.400393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799133fc-d3ad-4c12-854c-fd9413fbca78 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:15.446045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:15.475072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4075673-ab89-4ea4-a309-811da0644feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:15.476127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4075673-ab89-4ea4-a309-811da0644feb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:15.476593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4075673-ab89-4ea4-a309-811da0644feb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:15.477059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4075673-ab89-4ea4-a309-811da0644feb None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:15.480530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4075673-ab89-4ea4-a309-811da0644feb None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:15.483032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4075673-ab89-4ea4-a309-811da0644feb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:15.490717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 85/167] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:15 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:15.491741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4075673-ab89-4ea4-a309-811da0644feb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:15.611890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cacea-1377-4fd7-b1f6-bb8dca9e3f55 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:15.738576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf0c6-af5f-4ebe-9f42-c5bb780fa610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:15.739279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf0c6-af5f-4ebe-9f42-c5bb780fa610 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:15.739561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf0c6-af5f-4ebe-9f42-c5bb780fa610 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:15.739906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf0c6-af5f-4ebe-9f42-c5bb780fa610 None admin] PATH_INFO: `/v3/projects/a6a93a7a6ded46579442b8edfab10224` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:15.747223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf0c6-af5f-4ebe-9f42-c5bb780fa610 None admin] RBAC: Authorizing `identity:get_project(project_id=a6a93a7a6ded46579442b8edfab10224)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:15.753171 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf0c6-af5f-4ebe-9f42-c5bb780fa610 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:15.758164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 83/168] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:15 2022] GET /identity/v3/projects/a6a93a7a6ded46579442b8edfab10224 => generated 312 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:15.759401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf0c6-af5f-4ebe-9f42-c5bb780fa610 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:15.865382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4075673-ab89-4ea4-a309-811da0644feb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:15.932857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816495cb-0392-45aa-8ce6-f2249fcda255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:15.934017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816495cb-0392-45aa-8ce6-f2249fcda255 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:15.934496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816495cb-0392-45aa-8ce6-f2249fcda255 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:15.935032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816495cb-0392-45aa-8ce6-f2249fcda255 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:15.953884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816495cb-0392-45aa-8ce6-f2249fcda255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:15.955105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-816495cb-0392-45aa-8ce6-f2249fcda255 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:15.967349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:15.969457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:15.970473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:15.978319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 86/169] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:18:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 482 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:15.978533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf0c6-af5f-4ebe-9f42-c5bb780fa610 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:15.978696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e91037-30fa-458e-81e8-a60d85c8b7a7 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:15.978696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e91037-30fa-458e-81e8-a60d85c8b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:15.978696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e91037-30fa-458e-81e8-a60d85c8b7a7 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:15.980018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 87/170] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:15.980828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e91037-30fa-458e-81e8-a60d85c8b7a7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:16.030015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a1131-12ff-4fa9-8078-8b03d0c26863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:16.030015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a1131-12ff-4fa9-8078-8b03d0c26863 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:16.030015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a1131-12ff-4fa9-8078-8b03d0c26863 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:16.030015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a1131-12ff-4fa9-8078-8b03d0c26863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:16.030557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a1131-12ff-4fa9-8078-8b03d0c26863 None admin] RBAC: Adding query filter params (role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=5155bcda0dce418e98bae20b53135115, user.id=b81582df34a44b238abda1fb4c41a74a) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:16.030557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a1131-12ff-4fa9-8078-8b03d0c26863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:16.032174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a1131-12ff-4fa9-8078-8b03d0c26863 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:16.044431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 84/171] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:15 2022] GET /identity/v3/role_assignments?user.id=b81582df34a44b238abda1fb4c41a74a&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:16.046039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a1131-12ff-4fa9-8078-8b03d0c26863 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:16.110182 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:16.226988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e91037-30fa-458e-81e8-a60d85c8b7a7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:16.273003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a1131-12ff-4fa9-8078-8b03d0c26863 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:16.300468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fac17-9699-435f-a428-5335cb2826ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:16.301110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fac17-9699-435f-a428-5335cb2826ce None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:16.301392 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fac17-9699-435f-a428-5335cb2826ce None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:16.302342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fac17-9699-435f-a428-5335cb2826ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:16.303234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fac17-9699-435f-a428-5335cb2826ce None admin] RBAC: Adding query filter params (role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=a6a93a7a6ded46579442b8edfab10224, user.id=b81582df34a44b238abda1fb4c41a74a) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:16.303590 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fac17-9699-435f-a428-5335cb2826ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:16.305217 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fac17-9699-435f-a428-5335cb2826ce None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:16.313287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 88/172] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:15 2022] GET /identity/v3/role_assignments?user.id=b81582df34a44b238abda1fb4c41a74a&scope.project.id=a6a93a7a6ded46579442b8edfab10224&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:16.314098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fac17-9699-435f-a428-5335cb2826ce None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:16.335407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1420f7-ee8f-4537-8e0b-01121586f46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:16.336500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1420f7-ee8f-4537-8e0b-01121586f46b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:16.336877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1420f7-ee8f-4537-8e0b-01121586f46b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:16.337153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1420f7-ee8f-4537-8e0b-01121586f46b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:16.369475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1420f7-ee8f-4537-8e0b-01121586f46b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-1a1420f7-ee8f-4537-8e0b-01121586f46b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:16.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:16.381853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 85/173] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:16.384280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1420f7-ee8f-4537-8e0b-01121586f46b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:16.402724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:16.566151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fac17-9699-435f-a428-5335cb2826ce None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:16.578927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1420f7-ee8f-4537-8e0b-01121586f46b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:16.601630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:16.642012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abd741-0b6a-4b63-99e9-bc6a0240d699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:16.643213 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abd741-0b6a-4b63-99e9-bc6a0240d699 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:16.643505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abd741-0b6a-4b63-99e9-bc6a0240d699 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:16.643948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abd741-0b6a-4b63-99e9-bc6a0240d699 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:16.644230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46ef5d-343a-4a75-9519-900a3d9b4923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:16.645177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ef5d-343a-4a75-9519-900a3d9b4923 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:16.645597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ef5d-343a-4a75-9519-900a3d9b4923 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:16.646104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ef5d-343a-4a75-9519-900a3d9b4923 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:16.647366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46ef5d-343a-4a75-9519-900a3d9b4923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:16.647825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46ef5d-343a-4a75-9519-900a3d9b4923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:16.649718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46ef5d-343a-4a75-9519-900a3d9b4923 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:16.663710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 86/174] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:16.665343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abd741-0b6a-4b63-99e9-bc6a0240d699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:16.666696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bce1f-544b-448f-996e-e693e9b3b4b8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:16.667444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bce1f-544b-448f-996e-e693e9b3b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:16.668187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bce1f-544b-448f-996e-e693e9b3b4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-50abd741-0b6a-4b63-99e9-bc6a0240d699 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:16.671825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:16.673656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 89/175] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:16.679136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b97f6-b5be-496f-ba1a-bc6d0ab1e8ac None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:16.680314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b97f6-b5be-496f-ba1a-bc6d0ab1e8ac None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:16.680314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b97f6-b5be-496f-ba1a-bc6d0ab1e8ac None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:16.680314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 90/176] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:16.680314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b97f6-b5be-496f-ba1a-bc6d0ab1e8ac None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:16.693193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1a0bce1f-544b-448f-996e-e693e9b3b4b8 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:16.696376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1a0bce1f-544b-448f-996e-e693e9b3b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:16.785006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 87/177] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:16.795172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bce1f-544b-448f-996e-e693e9b3b4b8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:16.797812 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:16.849560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b97f6-b5be-496f-ba1a-bc6d0ab1e8ac None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:16.905751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ff7c-903d-4a95-a11a-2c5e1c65514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:16.909478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ff7c-903d-4a95-a11a-2c5e1c65514f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:16.909760 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ff7c-903d-4a95-a11a-2c5e1c65514f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:16.910208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ff7c-903d-4a95-a11a-2c5e1c65514f None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:16.910963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ff7c-903d-4a95-a11a-2c5e1c65514f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:16.911429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ff7c-903d-4a95-a11a-2c5e1c65514f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:16.913658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ff7c-903d-4a95-a11a-2c5e1c65514f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:16.927984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 91/178] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:16.929414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c258666-4fcd-47e9-b79f-6b127f265f15 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:16.929713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c258666-4fcd-47e9-b79f-6b127f265f15 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:16.929987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c258666-4fcd-47e9-b79f-6b127f265f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:16.956193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8c258666-4fcd-47e9-b79f-6b127f265f15 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:16.957740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8c258666-4fcd-47e9-b79f-6b127f265f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:16.957856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bce1f-544b-448f-996e-e693e9b3b4b8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:17.008133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547555c-a13c-4d47-8f1e-9f343b95ace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:17.009076 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547555c-a13c-4d47-8f1e-9f343b95ace4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:17.009647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547555c-a13c-4d47-8f1e-9f343b95ace4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:17.010168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547555c-a13c-4d47-8f1e-9f343b95ace4 None admin] PATH_INFO: `/v3/users/4cd618c84674445b8b18062be3eac4f8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:17.011835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547555c-a13c-4d47-8f1e-9f343b95ace4 None admin] RBAC: Authorizing `identity:get_user(user_id=4cd618c84674445b8b18062be3eac4f8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:17.013521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:17.015085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547555c-a13c-4d47-8f1e-9f343b95ace4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:17.018444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 88/179] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:16 2022] GET /identity/v3/users/4cd618c84674445b8b18062be3eac4f8 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:17.020574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547555c-a13c-4d47-8f1e-9f343b95ace4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:17.060647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 92/180] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:17.061485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c258666-4fcd-47e9-b79f-6b127f265f15 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:17.181803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c258666-4fcd-47e9-b79f-6b127f265f15 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:17.205656 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:17.225245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab33a4c-a44d-45bc-a59e-6ede88ff4811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:17.225891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab33a4c-a44d-45bc-a59e-6ede88ff4811 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:17.226277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab33a4c-a44d-45bc-a59e-6ede88ff4811 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:17.226553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab33a4c-a44d-45bc-a59e-6ede88ff4811 None admin] PATH_INFO: `/v3/users/bb29552893d14786a13563ce1f4515cd` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:17.242560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab33a4c-a44d-45bc-a59e-6ede88ff4811 None admin] RBAC: Authorizing `identity:get_user(user_id=bb29552893d14786a13563ce1f4515cd)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:17.246177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab33a4c-a44d-45bc-a59e-6ede88ff4811 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:17.246177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 93/181] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:17 2022] GET /identity/v3/users/bb29552893d14786a13563ce1f4515cd => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:17.246925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab33a4c-a44d-45bc-a59e-6ede88ff4811 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:17.271913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547555c-a13c-4d47-8f1e-9f343b95ace4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:17.282625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:17.338237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7db75-49ce-4f59-a3d2-d0eeca8eec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:17.339122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7db75-49ce-4f59-a3d2-d0eeca8eec12 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:17.339574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7db75-49ce-4f59-a3d2-d0eeca8eec12 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:17.340042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7db75-49ce-4f59-a3d2-d0eeca8eec12 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:17.341494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7db75-49ce-4f59-a3d2-d0eeca8eec12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:17.341994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7db75-49ce-4f59-a3d2-d0eeca8eec12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:17.343961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7db75-49ce-4f59-a3d2-d0eeca8eec12 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:17.358805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 89/182] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:17.360436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7db75-49ce-4f59-a3d2-d0eeca8eec12 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:17.381247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab33a4c-a44d-45bc-a59e-6ede88ff4811 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:17.427725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebf350-d4c3-4ec4-b3eb-31e7c8c0707f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:17.428352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf350-d4c3-4ec4-b3eb-31e7c8c0707f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:17.428662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf350-d4c3-4ec4-b3eb-31e7c8c0707f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:17.428951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf350-d4c3-4ec4-b3eb-31e7c8c0707f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:17.488607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7db75-49ce-4f59-a3d2-d0eeca8eec12 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:17.521920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:17.527773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba9896-d8f0-428d-a2ee-a8cae749bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:17.528435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba9896-d8f0-428d-a2ee-a8cae749bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:17.528711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba9896-d8f0-428d-a2ee-a8cae749bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:17.528988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba9896-d8f0-428d-a2ee-a8cae749bbf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:17.530187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba9896-d8f0-428d-a2ee-a8cae749bbf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:17.531791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba9896-d8f0-428d-a2ee-a8cae749bbf1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:17.533433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 90/183] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:17.534830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba9896-d8f0-428d-a2ee-a8cae749bbf1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:17.538858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebf350-d4c3-4ec4-b3eb-31e7c8c0707f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:17.542998 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebf350-d4c3-4ec4-b3eb-31e7c8c0707f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:17.595936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:17.674544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba9896-d8f0-428d-a2ee-a8cae749bbf1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:17.688851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 94/184] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:17.690038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2f1c-6351-41de-8f1f-09cc38231daa None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:17.690320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2f1c-6351-41de-8f1f-09cc38231daa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:17.690695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2f1c-6351-41de-8f1f-09cc38231daa None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:17.691991 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 95/185] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:17.692680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2f1c-6351-41de-8f1f-09cc38231daa None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:17.725789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebd9f0-6e86-4922-b931-eb3e9112ccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:17.726512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebd9f0-6e86-4922-b931-eb3e9112ccf1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:17.726877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebd9f0-6e86-4922-b931-eb3e9112ccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:17.727209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebd9f0-6e86-4922-b931-eb3e9112ccf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:17.824747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2f1c-6351-41de-8f1f-09cc38231daa None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:17.828223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:17.832020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebd9f0-6e86-4922-b931-eb3e9112ccf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:17.835120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebd9f0-6e86-4922-b931-eb3e9112ccf1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:17.858872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:17.865739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f43bf-32d2-4a25-a3ae-0604da711e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:17.866426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f43bf-32d2-4a25-a3ae-0604da711e07 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:17.866754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f43bf-32d2-4a25-a3ae-0604da711e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:17.867034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f43bf-32d2-4a25-a3ae-0604da711e07 None admin] PATH_INFO: `/v3/users/b81582df34a44b238abda1fb4c41a74a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:17.868376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f43bf-32d2-4a25-a3ae-0604da711e07 None admin] RBAC: Authorizing `identity:get_user(user_id=b81582df34a44b238abda1fb4c41a74a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:17.869897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f43bf-32d2-4a25-a3ae-0604da711e07 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:17.872017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 96/186] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:17 2022] GET /identity/v3/users/b81582df34a44b238abda1fb4c41a74a => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:17.872865 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f43bf-32d2-4a25-a3ae-0604da711e07 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:17.979464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 91/187] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:17.980592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebd9f0-6e86-4922-b931-eb3e9112ccf1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:17.997907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f43bf-32d2-4a25-a3ae-0604da711e07 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:18.042992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4692aa-f49f-4559-a411-11bf8c5f95ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:18.043632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4692aa-f49f-4559-a411-11bf8c5f95ad None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:18.043901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4692aa-f49f-4559-a411-11bf8c5f95ad None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:18.044163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4692aa-f49f-4559-a411-11bf8c5f95ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:18.061318 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4692aa-f49f-4559-a411-11bf8c5f95ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ed4692aa-f49f-4559-a411-11bf8c5f95ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:18.066253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:18.067164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:18.068074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 97/188] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:18.068717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4692aa-f49f-4559-a411-11bf8c5f95ad None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:18.125392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:18.130369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebd9f0-6e86-4922-b931-eb3e9112ccf1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:18.135085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:18.184406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5dc27-885f-4347-b4e7-e4c6a699d82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:18.185079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5dc27-885f-4347-b4e7-e4c6a699d82e None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:18.185377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5dc27-885f-4347-b4e7-e4c6a699d82e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:18.185652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5dc27-885f-4347-b4e7-e4c6a699d82e None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:18.186423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5dc27-885f-4347-b4e7-e4c6a699d82e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:18.186626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4692aa-f49f-4559-a411-11bf8c5f95ad None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:18.188170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5dc27-885f-4347-b4e7-e4c6a699d82e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:18.213902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 92/189] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:17 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:18.216568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5d807-c0cd-43f3-ba35-1280f902b2eb None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:18.217006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5d807-c0cd-43f3-ba35-1280f902b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:18.217469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5d807-c0cd-43f3-ba35-1280f902b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:18.231649 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81118-73e3-48fa-8539-a158dd3911e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:18.232391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81118-73e3-48fa-8539-a158dd3911e8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:18.232727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81118-73e3-48fa-8539-a158dd3911e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:18.232987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81118-73e3-48fa-8539-a158dd3911e8 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:18.234509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81118-73e3-48fa-8539-a158dd3911e8 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:18.236191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81118-73e3-48fa-8539-a158dd3911e8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:18.244495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 98/190] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:18 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:18.244495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81118-73e3-48fa-8539-a158dd3911e8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:18.246686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-43e5d807-c0cd-43f3-ba35-1280f902b2eb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:18.248463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-43e5d807-c0cd-43f3-ba35-1280f902b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:18.347845 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 93/191] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:18.355982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5d807-c0cd-43f3-ba35-1280f902b2eb None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:18.417825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81118-73e3-48fa-8539-a158dd3911e8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:18.458798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:18.478531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dc090-2917-4857-818a-da766adf9780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:18.480174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dc090-2917-4857-818a-da766adf9780 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:18.480842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dc090-2917-4857-818a-da766adf9780 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:18.481418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dc090-2917-4857-818a-da766adf9780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:18.532153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:18.557351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5d807-c0cd-43f3-ba35-1280f902b2eb None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:18.640464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05f261-7797-4619-95bd-e4ad9a366913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:18.641191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05f261-7797-4619-95bd-e4ad9a366913 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:18.641462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05f261-7797-4619-95bd-e4ad9a366913 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:18.641767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05f261-7797-4619-95bd-e4ad9a366913 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:18.643068 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05f261-7797-4619-95bd-e4ad9a366913 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:18.644494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05f261-7797-4619-95bd-e4ad9a366913 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:18.646527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 94/192] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:18 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:18.648165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05f261-7797-4619-95bd-e4ad9a366913 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:18.648795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dc090-2917-4857-818a-da766adf9780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:18.650441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dc090-2917-4857-818a-da766adf9780 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:18.817382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 99/193] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:18.818452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dc090-2917-4857-818a-da766adf9780 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:18.850993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05f261-7797-4619-95bd-e4ad9a366913 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:18.859124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:18.917285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7e125-43b9-45cf-bfaf-2c098f450a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:18.918432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7e125-43b9-45cf-bfaf-2c098f450a6d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:18.919032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7e125-43b9-45cf-bfaf-2c098f450a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:18.919541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7e125-43b9-45cf-bfaf-2c098f450a6d None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:18.920433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7e125-43b9-45cf-bfaf-2c098f450a6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:18.921123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7e125-43b9-45cf-bfaf-2c098f450a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:18.922924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7e125-43b9-45cf-bfaf-2c098f450a6d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:18.933352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 95/194] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:18.934625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7e125-43b9-45cf-bfaf-2c098f450a6d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:18.956108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:18.967930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dc090-2917-4857-818a-da766adf9780 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:19.028778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff8706-c456-4074-8efd-136ffae0b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:19.029173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff8706-c456-4074-8efd-136ffae0b896 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:19.029373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff8706-c456-4074-8efd-136ffae0b896 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:19.029789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff8706-c456-4074-8efd-136ffae0b896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:19.030635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff8706-c456-4074-8efd-136ffae0b896 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=5155bcda0dce418e98bae20b53135115, user.id=4cd618c84674445b8b18062be3eac4f8) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:19.030966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff8706-c456-4074-8efd-136ffae0b896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:19.032936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff8706-c456-4074-8efd-136ffae0b896 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:19.040553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 100/195] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:18 2022] GET /identity/v3/role_assignments?user.id=4cd618c84674445b8b18062be3eac4f8&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:19.041705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff8706-c456-4074-8efd-136ffae0b896 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:19.064381 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7e125-43b9-45cf-bfaf-2c098f450a6d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:19.110140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd13aa-93f7-44cc-b102-cda71a7282dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:19.111219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd13aa-93f7-44cc-b102-cda71a7282dc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:19.111822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd13aa-93f7-44cc-b102-cda71a7282dc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:19.112297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd13aa-93f7-44cc-b102-cda71a7282dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:19.113474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd13aa-93f7-44cc-b102-cda71a7282dc None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=92436548309e4b6f9ccf5357c5fb8342, user.id=bb29552893d14786a13563ce1f4515cd) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:19.113994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd13aa-93f7-44cc-b102-cda71a7282dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:19.115895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd13aa-93f7-44cc-b102-cda71a7282dc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:19.123839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 96/196] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:18 2022] GET /identity/v3/role_assignments?user.id=bb29552893d14786a13563ce1f4515cd&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:19.125134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd13aa-93f7-44cc-b102-cda71a7282dc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:19.193957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff8706-c456-4074-8efd-136ffae0b896 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:19.199368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:19.249068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6adc52-517e-42fe-9927-7cee9462f1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:19.259112 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6adc52-517e-42fe-9927-7cee9462f1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:19.259112 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6adc52-517e-42fe-9927-7cee9462f1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:19.259112 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6adc52-517e-42fe-9927-7cee9462f1b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6adc52-517e-42fe-9927-7cee9462f1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-fc6adc52-517e-42fe-9927-7cee9462f1b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:19.278684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:19.280716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:19.281645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:19.283776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 101/197] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:19.284120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6adc52-517e-42fe-9927-7cee9462f1b4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:19.299878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:19.335698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd13aa-93f7-44cc-b102-cda71a7282dc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:19.403311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2904ba-64fd-4344-97d1-aee3c4599d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:19.404313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2904ba-64fd-4344-97d1-aee3c4599d6c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:19.404792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2904ba-64fd-4344-97d1-aee3c4599d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:19.405278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2904ba-64fd-4344-97d1-aee3c4599d6c None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:19.409117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2904ba-64fd-4344-97d1-aee3c4599d6c None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:19.411024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2904ba-64fd-4344-97d1-aee3c4599d6c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:19.414094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 97/198] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:19 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:19.415448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2904ba-64fd-4344-97d1-aee3c4599d6c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:19.438372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6adc52-517e-42fe-9927-7cee9462f1b4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:19.494245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69092b1-0d51-4ceb-ab16-fd0552c9b5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:19.494245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69092b1-0d51-4ceb-ab16-fd0552c9b5ac None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:19.494245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69092b1-0d51-4ceb-ab16-fd0552c9b5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:19.494245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69092b1-0d51-4ceb-ab16-fd0552c9b5ac None admin] PATH_INFO: `/v3/users/bb29552893d14786a13563ce1f4515cd` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:19.495014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69092b1-0d51-4ceb-ab16-fd0552c9b5ac None admin] RBAC: Authorizing `identity:get_user(user_id=bb29552893d14786a13563ce1f4515cd)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:19.496844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69092b1-0d51-4ceb-ab16-fd0552c9b5ac None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:19.499248 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 102/199] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:19 2022] GET /identity/v3/users/bb29552893d14786a13563ce1f4515cd => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:19.500290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69092b1-0d51-4ceb-ab16-fd0552c9b5ac None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:19.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:19.679237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2904ba-64fd-4344-97d1-aee3c4599d6c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:19.742103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69092b1-0d51-4ceb-ab16-fd0552c9b5ac None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:19.763108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d9a3e-c3fe-49b1-8383-d82bf45ef381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:19.765108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9a3e-c3fe-49b1-8383-d82bf45ef381 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:19.765889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9a3e-c3fe-49b1-8383-d82bf45ef381 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:19.767661 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9a3e-c3fe-49b1-8383-d82bf45ef381 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:19.768658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d9a3e-c3fe-49b1-8383-d82bf45ef381 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:19.769354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d9a3e-c3fe-49b1-8383-d82bf45ef381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:19.771960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d9a3e-c3fe-49b1-8383-d82bf45ef381 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:19.791714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 98/200] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:19.793222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d9a3e-c3fe-49b1-8383-d82bf45ef381 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:19.826317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0dff-32b4-4fa0-af3d-194a78e2b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:19.827473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0dff-32b4-4fa0-af3d-194a78e2b9ea None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:19.828201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:19.831091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0dff-32b4-4fa0-af3d-194a78e2b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:19.832411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0dff-32b4-4fa0-af3d-194a78e2b9ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:19.834970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b0dff-32b4-4fa0-af3d-194a78e2b9ea None admin] RBAC: Adding query filter params (role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=5155bcda0dce418e98bae20b53135115, user.id=b81582df34a44b238abda1fb4c41a74a) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:19.837166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b0dff-32b4-4fa0-af3d-194a78e2b9ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:19.842004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b0dff-32b4-4fa0-af3d-194a78e2b9ea None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:19.858183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 103/201] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:19 2022] GET /identity/v3/role_assignments?user.id=b81582df34a44b238abda1fb4c41a74a&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=2e42b82a17a84744960aa3904ab682cc => generated 608 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:19.861155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0dff-32b4-4fa0-af3d-194a78e2b9ea None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:20.015874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:20.046323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0dff-32b4-4fa0-af3d-194a78e2b9ea None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:20.048905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d9a3e-c3fe-49b1-8383-d82bf45ef381 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:20.123433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1db3c7-2f38-4634-841e-4b627ec174a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:20.125413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db3c7-2f38-4634-841e-4b627ec174a7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:20.127858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db3c7-2f38-4634-841e-4b627ec174a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:20.129893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db3c7-2f38-4634-841e-4b627ec174a7 None admin] PATH_INFO: `/v3/users/e14deaf49b804728bc5b64508db33dfb` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:20.135309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1db3c7-2f38-4634-841e-4b627ec174a7 None admin] RBAC: Authorizing `identity:get_user(user_id=e14deaf49b804728bc5b64508db33dfb)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:20.139339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1db3c7-2f38-4634-841e-4b627ec174a7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:20.144778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae667-f810-4595-9dfb-d983801b7a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:20.146196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae667-f810-4595-9dfb-d983801b7a93 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:20.146805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae667-f810-4595-9dfb-d983801b7a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:20.147383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 104/202] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:19 2022] GET /identity/v3/users/e14deaf49b804728bc5b64508db33dfb => generated 289 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:20.147897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae667-f810-4595-9dfb-d983801b7a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:20.153123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1db3c7-2f38-4634-841e-4b627ec174a7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:20.256152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae667-f810-4595-9dfb-d983801b7a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:20.258024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae667-f810-4595-9dfb-d983801b7a93 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:20.272106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:20.384888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 99/203] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:20.391723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae667-f810-4595-9dfb-d983801b7a93 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:20.407646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1db3c7-2f38-4634-841e-4b627ec174a7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:20.461785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b247a-f6ba-4ed4-9b60-a64a25d64b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:20.462798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b247a-f6ba-4ed4-9b60-a64a25d64b43 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:20.463403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b247a-f6ba-4ed4-9b60-a64a25d64b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:20.463958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b247a-f6ba-4ed4-9b60-a64a25d64b43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:20.516685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:20.540180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae667-f810-4595-9dfb-d983801b7a93 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:20.553604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:20.589719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe6a9f-8b55-486c-b0de-ec6a8d9681d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:20.589719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe6a9f-8b55-486c-b0de-ec6a8d9681d5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:20.589719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe6a9f-8b55-486c-b0de-ec6a8d9681d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:20.589719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe6a9f-8b55-486c-b0de-ec6a8d9681d5 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:20.593073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe6a9f-8b55-486c-b0de-ec6a8d9681d5 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:20.593855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe6a9f-8b55-486c-b0de-ec6a8d9681d5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:20.602694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 100/204] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:20 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:20.602694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe6a9f-8b55-486c-b0de-ec6a8d9681d5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:20.648020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b247a-f6ba-4ed4-9b60-a64a25d64b43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:20.649573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b247a-f6ba-4ed4-9b60-a64a25d64b43 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:20.728322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe6a9f-8b55-486c-b0de-ec6a8d9681d5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:20.766605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65663ef-d79b-4d8e-b69d-8ba50e377d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:20.767603 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65663ef-d79b-4d8e-b69d-8ba50e377d30 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:20.768074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65663ef-d79b-4d8e-b69d-8ba50e377d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:20.768535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65663ef-d79b-4d8e-b69d-8ba50e377d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:20.769468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65663ef-d79b-4d8e-b69d-8ba50e377d30 None admin] RBAC: Adding query filter params (role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=92436548309e4b6f9ccf5357c5fb8342, user.id=bb29552893d14786a13563ce1f4515cd) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:20.769993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65663ef-d79b-4d8e-b69d-8ba50e377d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:20.771745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65663ef-d79b-4d8e-b69d-8ba50e377d30 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:20.782796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 101/205] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:20 2022] GET /identity/v3/role_assignments?user.id=bb29552893d14786a13563ce1f4515cd&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=2e42b82a17a84744960aa3904ab682cc => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:20.855164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 105/206] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:20.860995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65663ef-d79b-4d8e-b69d-8ba50e377d30 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:20.976552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:21.054217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65663ef-d79b-4d8e-b69d-8ba50e377d30 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:21.097112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2097b-6f3a-4ca8-98df-3a95d83121ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:21.098143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2097b-6f3a-4ca8-98df-3a95d83121ff None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:21.098637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2097b-6f3a-4ca8-98df-3a95d83121ff None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:21.099191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2097b-6f3a-4ca8-98df-3a95d83121ff None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:21.100780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2097b-6f3a-4ca8-98df-3a95d83121ff None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:21.102478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2097b-6f3a-4ca8-98df-3a95d83121ff None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:21.104453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 102/207] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:20 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:21.110617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b247a-f6ba-4ed4-9b60-a64a25d64b43 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:21.195697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:21.259543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433df5fd-1594-4f00-b13e-7504cffd2340 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:21.259970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433df5fd-1594-4f00-b13e-7504cffd2340 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:21.260249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433df5fd-1594-4f00-b13e-7504cffd2340 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:21.261806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 103/208] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:18:21.272720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b247a-f6ba-4ed4-9b60-a64a25d64b43 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:21.280731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60793-70f6-4e4d-aa16-364806b5a824 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:21.281143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60793-70f6-4e4d-aa16-364806b5a824 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:21.281421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60793-70f6-4e4d-aa16-364806b5a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:21.308124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b0b60793-70f6-4e4d-aa16-364806b5a824 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:21.309341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b0b60793-70f6-4e4d-aa16-364806b5a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:21.381076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe2df3-d0e5-485a-9fdf-1846d2d5cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:21.381989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2df3-d0e5-485a-9fdf-1846d2d5cce1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:21.382443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2df3-d0e5-485a-9fdf-1846d2d5cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:21.382932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2df3-d0e5-485a-9fdf-1846d2d5cce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:21.384330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2df3-d0e5-485a-9fdf-1846d2d5cce1 None admin] RBAC: Adding query filter params (role.id=df51cbf6777f4f5990a32ae5d5c1ce0e, scope.project.id=5155bcda0dce418e98bae20b53135115, user.id=e14deaf49b804728bc5b64508db33dfb) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:21.384870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2df3-d0e5-485a-9fdf-1846d2d5cce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:21.387022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2df3-d0e5-485a-9fdf-1846d2d5cce1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:21.402814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 104/209] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:21.409281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 106/210] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:21 2022] GET /identity/v3/role_assignments?user.id=e14deaf49b804728bc5b64508db33dfb&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=df51cbf6777f4f5990a32ae5d5c1ce0e => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:21.605549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ae952-a810-43bf-a789-211b4cf5565b None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:21.605858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ae952-a810-43bf-a789-211b4cf5565b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:21.610136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ae952-a810-43bf-a789-211b4cf5565b None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:21.610136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 105/211] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:21.619916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4124-6af9-4e5c-947e-c41a1cdcb38e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:21.620712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4124-6af9-4e5c-947e-c41a1cdcb38e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:21.621334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4124-6af9-4e5c-947e-c41a1cdcb38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:21.646312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a78b4124-6af9-4e5c-947e-c41a1cdcb38e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:21.648316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a78b4124-6af9-4e5c-947e-c41a1cdcb38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:21.734250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ae952-a810-43bf-a789-211b4cf5565b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:21.780737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 107/212] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:21.814196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:21.898069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ae952-a810-43bf-a789-211b4cf5565b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:21.951615 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40a4c9-750a-4b0a-9cac-9a8545002d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:21.952652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40a4c9-750a-4b0a-9cac-9a8545002d2c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:21.953082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40a4c9-750a-4b0a-9cac-9a8545002d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:21.953448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40a4c9-750a-4b0a-9cac-9a8545002d2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:21.974365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40a4c9-750a-4b0a-9cac-9a8545002d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6d40a4c9-750a-4b0a-9cac-9a8545002d2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:21.984087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:21.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:21.986461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:21.989174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 106/213] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:21.998397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b4124-6af9-4e5c-947e-c41a1cdcb38e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:22.098231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:22.159138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b4124-6af9-4e5c-947e-c41a1cdcb38e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:22.176827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca8ae-397a-433f-857e-9a3a5393be00 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:22.177524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca8ae-397a-433f-857e-9a3a5393be00 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:22.177969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca8ae-397a-433f-857e-9a3a5393be00 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:22.180319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 107/214] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:22.186806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd7e4e-de95-431f-af5d-4a6aaa8faa7d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:22.187364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd7e4e-de95-431f-af5d-4a6aaa8faa7d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:22.187782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd7e4e-de95-431f-af5d-4a6aaa8faa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:22.206271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630af532-faf1-4d88-beaa-074fc950156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:22.207271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630af532-faf1-4d88-beaa-074fc950156d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:22.207742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630af532-faf1-4d88-beaa-074fc950156d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:22.208196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630af532-faf1-4d88-beaa-074fc950156d None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:22.209265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630af532-faf1-4d88-beaa-074fc950156d None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:22.209798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630af532-faf1-4d88-beaa-074fc950156d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:22.211131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-eedd7e4e-de95-431f-af5d-4a6aaa8faa7d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:22.211694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630af532-faf1-4d88-beaa-074fc950156d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:22.212342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eedd7e4e-de95-431f-af5d-4a6aaa8faa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:22.227062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 108/215] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:22.227062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630af532-faf1-4d88-beaa-074fc950156d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:22.316720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 108/216] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:22.316720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd7e4e-de95-431f-af5d-4a6aaa8faa7d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:22.346242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:22.385991 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630af532-faf1-4d88-beaa-074fc950156d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:22.399198 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:22.435069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dda1b-674c-442f-bd15-5e56450a284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:22.435716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dda1b-674c-442f-bd15-5e56450a284f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:22.435996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dda1b-674c-442f-bd15-5e56450a284f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:22.436297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dda1b-674c-442f-bd15-5e56450a284f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:22.437640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dda1b-674c-442f-bd15-5e56450a284f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:22.439396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dda1b-674c-442f-bd15-5e56450a284f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:22.441492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 109/217] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:22.454782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dda1b-674c-442f-bd15-5e56450a284f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:22.464256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd7e4e-de95-431f-af5d-4a6aaa8faa7d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:22.528893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a84d8-5c85-4076-9c25-ba3ee87ada33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:22.529867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a84d8-5c85-4076-9c25-ba3ee87ada33 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:22.530204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a84d8-5c85-4076-9c25-ba3ee87ada33 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:22.530505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a84d8-5c85-4076-9c25-ba3ee87ada33 None admin] PATH_INFO: `/v3/users/07a538e76b6a4926bd55a87a8238c691` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:22.549013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a84d8-5c85-4076-9c25-ba3ee87ada33 None admin] RBAC: Authorizing `identity:get_user(user_id=07a538e76b6a4926bd55a87a8238c691)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:22.550741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a84d8-5c85-4076-9c25-ba3ee87ada33 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:22.552988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 109/218] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:22 2022] GET /identity/v3/users/07a538e76b6a4926bd55a87a8238c691 => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:22.559667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a84d8-5c85-4076-9c25-ba3ee87ada33 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:22.598531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dda1b-674c-442f-bd15-5e56450a284f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:22.649937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffb993-f63c-4abd-ab7d-bc2c7ff9b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:22.650793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffb993-f63c-4abd-ab7d-bc2c7ff9b1cb None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:22.651281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffb993-f63c-4abd-ab7d-bc2c7ff9b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:22.651591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffb993-f63c-4abd-ab7d-bc2c7ff9b1cb None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:22.652634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffb993-f63c-4abd-ab7d-bc2c7ff9b1cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:22.654485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffb993-f63c-4abd-ab7d-bc2c7ff9b1cb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:22.682705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:22.691248 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 110/219] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:22 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:22.693957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffb993-f63c-4abd-ab7d-bc2c7ff9b1cb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:22.702352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a84d8-5c85-4076-9c25-ba3ee87ada33 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:22.755550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87548d0-02ef-4e16-8314-3a8372928dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:22.756867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87548d0-02ef-4e16-8314-3a8372928dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:22.757323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87548d0-02ef-4e16-8314-3a8372928dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:22.757842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87548d0-02ef-4e16-8314-3a8372928dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:22.761297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:22.874205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffb993-f63c-4abd-ab7d-bc2c7ff9b1cb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:22.882316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87548d0-02ef-4e16-8314-3a8372928dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:22.884788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87548d0-02ef-4e16-8314-3a8372928dd4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:22.922553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d933a54-6f61-4c8a-aeb0-a8d1bc1a739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:22.923256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d933a54-6f61-4c8a-aeb0-a8d1bc1a739d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:22.923536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d933a54-6f61-4c8a-aeb0-a8d1bc1a739d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:22.923803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d933a54-6f61-4c8a-aeb0-a8d1bc1a739d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:22.943273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d933a54-6f61-4c8a-aeb0-a8d1bc1a739d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5d933a54-6f61-4c8a-aeb0-a8d1bc1a739d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:22.949583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:22.950996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:22.952306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 111/220] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:22.957231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d933a54-6f61-4c8a-aeb0-a8d1bc1a739d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:23.022912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:23.053006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 110/221] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:18:23.053006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87548d0-02ef-4e16-8314-3a8372928dd4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:23.123259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:23.139494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d933a54-6f61-4c8a-aeb0-a8d1bc1a739d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:23.198621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39c4b8-2def-4a5f-a004-b6509dbf6c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:23.200267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39c4b8-2def-4a5f-a004-b6509dbf6c63 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:23.200911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39c4b8-2def-4a5f-a004-b6509dbf6c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:23.201544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39c4b8-2def-4a5f-a004-b6509dbf6c63 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:23.203106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39c4b8-2def-4a5f-a004-b6509dbf6c63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:23.204259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39c4b8-2def-4a5f-a004-b6509dbf6c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:23.207764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39c4b8-2def-4a5f-a004-b6509dbf6c63 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:23.214949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87548d0-02ef-4e16-8314-3a8372928dd4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:23.230686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 112/222] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:23.230686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebff6f-c283-41b6-ab2a-1a27e442047b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:23.230686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebff6f-c283-41b6-ab2a-1a27e442047b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:23.230686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebff6f-c283-41b6-ab2a-1a27e442047b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:23.230686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 113/223] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:23.235645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f4d32-d430-4f43-9d86-9a08e3d3978e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:23.235956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f4d32-d430-4f43-9d86-9a08e3d3978e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:23.236187 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f4d32-d430-4f43-9d86-9a08e3d3978e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:23.271235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d10f4d32-d430-4f43-9d86-9a08e3d3978e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:23.273183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d10f4d32-d430-4f43-9d86-9a08e3d3978e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:23.281796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a188a-0afb-4224-8496-bf84e33012e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:23.282451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a188a-0afb-4224-8496-bf84e33012e5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:23.282773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a188a-0afb-4224-8496-bf84e33012e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:23.283063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a188a-0afb-4224-8496-bf84e33012e5 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:23.284795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a188a-0afb-4224-8496-bf84e33012e5 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:23.287474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a188a-0afb-4224-8496-bf84e33012e5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:23.289323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 111/224] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:23 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:23.290224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a188a-0afb-4224-8496-bf84e33012e5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:23.394720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 114/225] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:23.395628 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f4d32-d430-4f43-9d86-9a08e3d3978e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:23.403351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:23.482441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a188a-0afb-4224-8496-bf84e33012e5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:23.554956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb463-dfa2-4815-bd85-2a34430f828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:23.557983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb463-dfa2-4815-bd85-2a34430f828b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:23.559197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb463-dfa2-4815-bd85-2a34430f828b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:23.562050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb463-dfa2-4815-bd85-2a34430f828b None admin] PATH_INFO: `/v3/users/bb29552893d14786a13563ce1f4515cd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:23.565447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb463-dfa2-4815-bd85-2a34430f828b None admin] RBAC: Authorizing `identity:get_user(user_id=bb29552893d14786a13563ce1f4515cd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:23.569153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb463-dfa2-4815-bd85-2a34430f828b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:23.571915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 112/226] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:23 2022] GET /identity/v3/users/bb29552893d14786a13563ce1f4515cd => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:23.578815 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb463-dfa2-4815-bd85-2a34430f828b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:23.636621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:23.686343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f4d32-d430-4f43-9d86-9a08e3d3978e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:23.752847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ec04e-ff87-43c9-8f6d-5385efdc8104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:23.753411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec04e-ff87-43c9-8f6d-5385efdc8104 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:23.753874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec04e-ff87-43c9-8f6d-5385efdc8104 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:23.754356 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec04e-ff87-43c9-8f6d-5385efdc8104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:23.755890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ec04e-ff87-43c9-8f6d-5385efdc8104 None admin] RBAC: Adding query filter params (role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=92436548309e4b6f9ccf5357c5fb8342, user.id=07a538e76b6a4926bd55a87a8238c691) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:23.756251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ec04e-ff87-43c9-8f6d-5385efdc8104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:23.757714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ec04e-ff87-43c9-8f6d-5385efdc8104 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:23.774061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 115/227] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:23 2022] GET /identity/v3/role_assignments?user.id=07a538e76b6a4926bd55a87a8238c691&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 259 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:23.808398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb463-dfa2-4815-bd85-2a34430f828b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:23.843044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:23.857449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837816a-e1a2-464c-a3ee-f39d59f87b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:23.858173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837816a-e1a2-464c-a3ee-f39d59f87b81 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:23.858429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837816a-e1a2-464c-a3ee-f39d59f87b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:23.858804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837816a-e1a2-464c-a3ee-f39d59f87b81 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:23.860483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837816a-e1a2-464c-a3ee-f39d59f87b81 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:23.862052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837816a-e1a2-464c-a3ee-f39d59f87b81 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:23.864620 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 113/228] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:23 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:23.867697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ec04e-ff87-43c9-8f6d-5385efdc8104 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:23.877950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837816a-e1a2-464c-a3ee-f39d59f87b81 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:24.001729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837816a-e1a2-464c-a3ee-f39d59f87b81 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:24.054093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96562a71-2321-4e8e-b136-496d94ef20f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:24.054734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96562a71-2321-4e8e-b136-496d94ef20f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:24.055075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96562a71-2321-4e8e-b136-496d94ef20f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:24.055350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96562a71-2321-4e8e-b136-496d94ef20f8 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342/users/bb29552893d14786a13563ce1f4515cd/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:24.057446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96562a71-2321-4e8e-b136-496d94ef20f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=92436548309e4b6f9ccf5357c5fb8342, user_id=bb29552893d14786a13563ce1f4515cd, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:24.059009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96562a71-2321-4e8e-b136-496d94ef20f8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:24.091265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 114/229] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:18:23 2022] PUT /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342/users/bb29552893d14786a13563ce1f4515cd/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:18:24.161908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ec04e-ff87-43c9-8f6d-5385efdc8104 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:24.249077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9b0d-68d4-49ae-b26a-31a681b35cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:24.250091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9b0d-68d4-49ae-b26a-31a681b35cab None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:24.250522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9b0d-68d4-49ae-b26a-31a681b35cab None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:24.250977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9b0d-68d4-49ae-b26a-31a681b35cab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:24.272092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f9b0d-68d4-49ae-b26a-31a681b35cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-4d6f9b0d-68d4-49ae-b26a-31a681b35cab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:24.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:24.283723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:24.284710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:24.285405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 116/230] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:18:24.291299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96562a71-2321-4e8e-b136-496d94ef20f8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:24.391424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:24.467636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96562a71-2321-4e8e-b136-496d94ef20f8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:24.514817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47f6ee-0452-4b80-bdff-72516681ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:24.515843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f6ee-0452-4b80-bdff-72516681ab62 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:24.516297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f6ee-0452-4b80-bdff-72516681ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:24.516713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f6ee-0452-4b80-bdff-72516681ab62 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:24.517949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47f6ee-0452-4b80-bdff-72516681ab62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:24.518479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47f6ee-0452-4b80-bdff-72516681ab62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:24.520225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47f6ee-0452-4b80-bdff-72516681ab62 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:24.532202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 115/231] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:24.538384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9b0d-68d4-49ae-b26a-31a681b35cab None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:24.552814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:24.676686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9b0d-68d4-49ae-b26a-31a681b35cab None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:24.713363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c212f-70da-4136-a1c3-4683dc0ed26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:24.714009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c212f-70da-4136-a1c3-4683dc0ed26f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:24.714284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c212f-70da-4136-a1c3-4683dc0ed26f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:24.714551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c212f-70da-4136-a1c3-4683dc0ed26f None admin] PATH_INFO: `/v3/users/bb29552893d14786a13563ce1f4515cd` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:24.715773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c212f-70da-4136-a1c3-4683dc0ed26f None admin] RBAC: Authorizing `identity:get_user(user_id=bb29552893d14786a13563ce1f4515cd)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:24.717237 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c212f-70da-4136-a1c3-4683dc0ed26f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:24.719268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 117/232] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:24 2022] GET /identity/v3/users/bb29552893d14786a13563ce1f4515cd => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:24.725159 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47f6ee-0452-4b80-bdff-72516681ab62 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:24.891495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47f6ee-0452-4b80-bdff-72516681ab62 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:24.915349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:24.941399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d692682-d974-45cb-bd8b-e8d174be34c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:24.942434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d692682-d974-45cb-bd8b-e8d174be34c5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:24.942995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d692682-d974-45cb-bd8b-e8d174be34c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:24.943464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d692682-d974-45cb-bd8b-e8d174be34c5 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:24.944898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d692682-d974-45cb-bd8b-e8d174be34c5 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:24.946561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d692682-d974-45cb-bd8b-e8d174be34c5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:24.949200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 116/233] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:24 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:24.954927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c212f-70da-4136-a1c3-4683dc0ed26f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:25.049939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:25.077071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c212f-70da-4136-a1c3-4683dc0ed26f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:25.113735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202287aa-7898-413d-bf6d-047fcc52315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:25.114413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202287aa-7898-413d-bf6d-047fcc52315c None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:25.114779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202287aa-7898-413d-bf6d-047fcc52315c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:25.115053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202287aa-7898-413d-bf6d-047fcc52315c None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342/users/bb29552893d14786a13563ce1f4515cd/roles/2e42b82a17a84744960aa3904ab682cc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:25.117300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202287aa-7898-413d-bf6d-047fcc52315c None admin] RBAC: Authorizing `identity:create_grant(project_id=92436548309e4b6f9ccf5357c5fb8342, user_id=bb29552893d14786a13563ce1f4515cd, role_id=2e42b82a17a84744960aa3904ab682cc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:25.118810 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202287aa-7898-413d-bf6d-047fcc52315c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:25.154630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 118/234] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:18:24 2022] PUT /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342/users/bb29552893d14786a13563ce1f4515cd/roles/2e42b82a17a84744960aa3904ab682cc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:25.418400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336748b-094d-4256-b173-b9a0d73be404 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:25.418770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336748b-094d-4256-b173-b9a0d73be404 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:25.418936 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336748b-094d-4256-b173-b9a0d73be404 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:25.420296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 117/235] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:25.426192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0860d5e-6f39-4bae-9309-b7ec5288d669 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:25.426765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0860d5e-6f39-4bae-9309-b7ec5288d669 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:25.426765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0860d5e-6f39-4bae-9309-b7ec5288d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:25.452985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a0860d5e-6f39-4bae-9309-b7ec5288d669 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:25.454262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a0860d5e-6f39-4bae-9309-b7ec5288d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:25.522542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595929-8578-49ac-b2e0-1e54e4b5089f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:25.522883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595929-8578-49ac-b2e0-1e54e4b5089f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:25.523138 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595929-8578-49ac-b2e0-1e54e4b5089f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:25.524684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 118/236] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:18:25.535279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03e0b4-3efd-4a77-9a17-affa5bcda4a3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:25.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03e0b4-3efd-4a77-9a17-affa5bcda4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:25.536354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03e0b4-3efd-4a77-9a17-affa5bcda4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:25.543160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 119/237] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:25.563614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7e03e0b4-3efd-4a77-9a17-affa5bcda4a3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:25.565102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7e03e0b4-3efd-4a77-9a17-affa5bcda4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:25.637307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 119/238] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:25.872541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0860d5e-6f39-4bae-9309-b7ec5288d669 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:25.948977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:25.974060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03e0b4-3efd-4a77-9a17-affa5bcda4a3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:26.006395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0860d5e-6f39-4bae-9309-b7ec5288d669 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:26.051287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8785e6-07b5-47f4-8a86-b447e0f9387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:26.052271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8785e6-07b5-47f4-8a86-b447e0f9387f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.052692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8785e6-07b5-47f4-8a86-b447e0f9387f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.053105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8785e6-07b5-47f4-8a86-b447e0f9387f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.065846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8785e6-07b5-47f4-8a86-b447e0f9387f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-cb8785e6-07b5-47f4-8a86-b447e0f9387f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:26.071403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:26.072499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:26.073749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:26.076186 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 120/239] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:26.084115 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8785e6-07b5-47f4-8a86-b447e0f9387f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:26.216056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03e0b4-3efd-4a77-9a17-affa5bcda4a3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:26.217520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8785e6-07b5-47f4-8a86-b447e0f9387f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:26.231019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:26.244369 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:26.254424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c0e80-8c76-4330-b20b-7141fc7bf176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:26.255233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c0e80-8c76-4330-b20b-7141fc7bf176 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.255651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c0e80-8c76-4330-b20b-7141fc7bf176 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.256108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c0e80-8c76-4330-b20b-7141fc7bf176 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.257436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c0e80-8c76-4330-b20b-7141fc7bf176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:26.258400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5f336-fbb8-4321-a744-ae74e954949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:26.258914 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c0e80-8c76-4330-b20b-7141fc7bf176 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:26.259479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5f336-fbb8-4321-a744-ae74e954949d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.259980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5f336-fbb8-4321-a744-ae74e954949d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.260459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5f336-fbb8-4321-a744-ae74e954949d None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.265098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 120/240] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:26.265940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5f336-fbb8-4321-a744-ae74e954949d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:26.266455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5f336-fbb8-4321-a744-ae74e954949d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:26.268088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5f336-fbb8-4321-a744-ae74e954949d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:26.278109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 121/241] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:26.284288 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c0e80-8c76-4330-b20b-7141fc7bf176 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:26.285453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5f336-fbb8-4321-a744-ae74e954949d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:26.391348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c0e80-8c76-4330-b20b-7141fc7bf176 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:26.429420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03dcec-b4ca-45b7-8347-5ec738c6094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:26.430219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03dcec-b4ca-45b7-8347-5ec738c6094f None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.430551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03dcec-b4ca-45b7-8347-5ec738c6094f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.430968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03dcec-b4ca-45b7-8347-5ec738c6094f None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.431719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03dcec-b4ca-45b7-8347-5ec738c6094f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:26.433537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03dcec-b4ca-45b7-8347-5ec738c6094f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:26.470792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 121/242] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:26 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:26.487309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5f336-fbb8-4321-a744-ae74e954949d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:26.521713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fe73-2feb-481a-92e9-c33617eab7d7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.522162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fe73-2feb-481a-92e9-c33617eab7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.522491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fe73-2feb-481a-92e9-c33617eab7d7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.524477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 122/243] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:26.532882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33450250-ff9c-499a-b986-cfe93d6355d2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.533253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33450250-ff9c-499a-b986-cfe93d6355d2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.533730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33450250-ff9c-499a-b986-cfe93d6355d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.547678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fca0f-5b11-4a82-998b-ee75485b3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:26.549567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fca0f-5b11-4a82-998b-ee75485b3910 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.550020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fca0f-5b11-4a82-998b-ee75485b3910 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.550459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fca0f-5b11-4a82-998b-ee75485b3910 None admin] PATH_INFO: `/v3/users/c895c7edc8d947799697246c0c969667` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.561093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-33450250-ff9c-499a-b986-cfe93d6355d2 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:26.561886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-33450250-ff9c-499a-b986-cfe93d6355d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:26.569670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fca0f-5b11-4a82-998b-ee75485b3910 None admin] RBAC: Authorizing `identity:get_user(user_id=c895c7edc8d947799697246c0c969667)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:26.572028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fca0f-5b11-4a82-998b-ee75485b3910 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:26.574867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 122/244] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:26 2022] GET /identity/v3/users/c895c7edc8d947799697246c0c969667 => generated 297 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:26.584026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fca0f-5b11-4a82-998b-ee75485b3910 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:26.632504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:26.680298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:26.716429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 123/245] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:26.755737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fca0f-5b11-4a82-998b-ee75485b3910 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:26.792156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb221c-aecd-40ce-bfd9-4f11b33eae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:26.792774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb221c-aecd-40ce-bfd9-4f11b33eae20 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.793045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb221c-aecd-40ce-bfd9-4f11b33eae20 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.793309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb221c-aecd-40ce-bfd9-4f11b33eae20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.865061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb221c-aecd-40ce-bfd9-4f11b33eae20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:26.866692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb221c-aecd-40ce-bfd9-4f11b33eae20 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:26.917422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:26.936953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f403e-b085-4db9-9acc-698176c5e85d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.937257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f403e-b085-4db9-9acc-698176c5e85d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.937487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f403e-b085-4db9-9acc-698176c5e85d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.939135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 124/246] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:18:26.952737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb05728-3747-42b0-b329-33599957d4b2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:26.953070 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb05728-3747-42b0-b329-33599957d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:26.953268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb05728-3747-42b0-b329-33599957d4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:26.975802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6eb05728-3747-42b0-b329-33599957d4b2 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:26.977634 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6eb05728-3747-42b0-b329-33599957d4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:26.987727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 123/247] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:26.994140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb221c-aecd-40ce-bfd9-4f11b33eae20 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:27.069635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 125/248] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:27.070454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb05728-3747-42b0-b329-33599957d4b2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:27.117823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb221c-aecd-40ce-bfd9-4f11b33eae20 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:27.162064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1379a-cf04-4a63-a040-af37bdb33f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:27.162885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1379a-cf04-4a63-a040-af37bdb33f69 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:27.163170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1379a-cf04-4a63-a040-af37bdb33f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:27.163438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1379a-cf04-4a63-a040-af37bdb33f69 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:27.164705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1379a-cf04-4a63-a040-af37bdb33f69 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:27.166184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1379a-cf04-4a63-a040-af37bdb33f69 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:27.168412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 124/249] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:26 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:27.176706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1379a-cf04-4a63-a040-af37bdb33f69 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:27.193718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:27.201861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:27.209822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb05728-3747-42b0-b329-33599957d4b2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:27.253537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78791c1e-d744-4ae6-b642-0ca3696effed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:27.254185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78791c1e-d744-4ae6-b642-0ca3696effed None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:27.254461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78791c1e-d744-4ae6-b642-0ca3696effed None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:27.254761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78791c1e-d744-4ae6-b642-0ca3696effed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:27.269684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78791c1e-d744-4ae6-b642-0ca3696effed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-78791c1e-d744-4ae6-b642-0ca3696effed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:27.276222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:27.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:27.277993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 126/250] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:27.302199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1379a-cf04-4a63-a040-af37bdb33f69 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:27.308610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78791c1e-d744-4ae6-b642-0ca3696effed None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:27.388839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7ce59-9ce7-4b23-912e-67e789297d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:27.389883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ce59-9ce7-4b23-912e-67e789297d00 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:27.390346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ce59-9ce7-4b23-912e-67e789297d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:27.390829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ce59-9ce7-4b23-912e-67e789297d00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:27.391774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7ce59-9ce7-4b23-912e-67e789297d00 None admin] RBAC: Adding query filter params (role.id=df51cbf6777f4f5990a32ae5d5c1ce0e, scope.project.id=92436548309e4b6f9ccf5357c5fb8342, user.id=c895c7edc8d947799697246c0c969667) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:27.392265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7ce59-9ce7-4b23-912e-67e789297d00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:27.393937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7ce59-9ce7-4b23-912e-67e789297d00 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:27.407526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 125/251] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:27 2022] GET /identity/v3/role_assignments?user.id=c895c7edc8d947799697246c0c969667&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=df51cbf6777f4f5990a32ae5d5c1ce0e => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:27.440854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7ce59-9ce7-4b23-912e-67e789297d00 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:27.486452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78791c1e-d744-4ae6-b642-0ca3696effed None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:27.555421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5b53d-a583-41ba-a165-cc37b346877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:27.556507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5b53d-a583-41ba-a165-cc37b346877a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:27.557042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5b53d-a583-41ba-a165-cc37b346877a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:27.557534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5b53d-a583-41ba-a165-cc37b346877a None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:27.558433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5b53d-a583-41ba-a165-cc37b346877a None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:27.558970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5b53d-a583-41ba-a165-cc37b346877a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:27.560998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5b53d-a583-41ba-a165-cc37b346877a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:27.588183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 127/252] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:27.596898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:27.597598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5b53d-a583-41ba-a165-cc37b346877a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:27.633091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:27.645270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7ce59-9ce7-4b23-912e-67e789297d00 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:27.687603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a76e1-0a8b-4c41-9ffd-57f97f3243c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:27.688290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a76e1-0a8b-4c41-9ffd-57f97f3243c6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:27.688570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a76e1-0a8b-4c41-9ffd-57f97f3243c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:27.689034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a76e1-0a8b-4c41-9ffd-57f97f3243c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:27.704579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a76e1-0a8b-4c41-9ffd-57f97f3243c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-af4a76e1-0a8b-4c41-9ffd-57f97f3243c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:27.710176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:27.711141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:27.711913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 126/253] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:27.713114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8226674-e6bf-4c9d-947e-b6bc12fa38e9 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:27.713829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8226674-e6bf-4c9d-947e-b6bc12fa38e9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:27.713829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8226674-e6bf-4c9d-947e-b6bc12fa38e9 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:27.715267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 127/254] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:27.718020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8226674-e6bf-4c9d-947e-b6bc12fa38e9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:27.787544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5b53d-a583-41ba-a165-cc37b346877a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:27.839946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8226674-e6bf-4c9d-947e-b6bc12fa38e9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:27.862474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b645dd3-613c-4a80-a44b-888c615addf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:27.863614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b645dd3-613c-4a80-a44b-888c615addf9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:27.864081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b645dd3-613c-4a80-a44b-888c615addf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:27.864597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b645dd3-613c-4a80-a44b-888c615addf9 None admin] PATH_INFO: `/v3/users/07a538e76b6a4926bd55a87a8238c691` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:27.868558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b645dd3-613c-4a80-a44b-888c615addf9 None admin] RBAC: Authorizing `identity:get_user(user_id=07a538e76b6a4926bd55a87a8238c691)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:27.870589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b645dd3-613c-4a80-a44b-888c615addf9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:27.872963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 128/255] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:27 2022] GET /identity/v3/users/07a538e76b6a4926bd55a87a8238c691 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:27.874438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afdc9d-ff56-4780-b27a-8b05480e3b7a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:27.878306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afdc9d-ff56-4780-b27a-8b05480e3b7a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:27.878970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afdc9d-ff56-4780-b27a-8b05480e3b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:27.881790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47635c39-8726-48da-99ea-e703f60ab811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:27.882465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47635c39-8726-48da-99ea-e703f60ab811 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:27.884321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47635c39-8726-48da-99ea-e703f60ab811 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:27.884321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47635c39-8726-48da-99ea-e703f60ab811 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:27.884321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47635c39-8726-48da-99ea-e703f60ab811 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:27.884321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47635c39-8726-48da-99ea-e703f60ab811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:27.885584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47635c39-8726-48da-99ea-e703f60ab811 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:27.888646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:27.898723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 128/256] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:27.899544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47635c39-8726-48da-99ea-e703f60ab811 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:27.905195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-63afdc9d-ff56-4780-b27a-8b05480e3b7a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:27.906748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-63afdc9d-ff56-4780-b27a-8b05480e3b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:28.026424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47635c39-8726-48da-99ea-e703f60ab811 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:28.027499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 129/257] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:28.029160 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afdc9d-ff56-4780-b27a-8b05480e3b7a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:28.051094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:28.080827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da2208-13a8-4008-b81e-1dae4a9458c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:28.081589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2208-13a8-4008-b81e-1dae4a9458c4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:28.081875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2208-13a8-4008-b81e-1dae4a9458c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:28.082151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2208-13a8-4008-b81e-1dae4a9458c4 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:28.083511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da2208-13a8-4008-b81e-1dae4a9458c4 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:28.085604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da2208-13a8-4008-b81e-1dae4a9458c4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:28.090774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 129/258] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:27 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:28.100253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da2208-13a8-4008-b81e-1dae4a9458c4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:28.158686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afdc9d-ff56-4780-b27a-8b05480e3b7a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:28.198683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:28.202940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafcb5e-7af8-4437-9068-b03d57be117f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:28.203649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafcb5e-7af8-4437-9068-b03d57be117f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:28.203927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafcb5e-7af8-4437-9068-b03d57be117f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:28.204197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafcb5e-7af8-4437-9068-b03d57be117f None admin] PATH_INFO: `/v3/users/bb29552893d14786a13563ce1f4515cd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:28.206935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafcb5e-7af8-4437-9068-b03d57be117f None admin] RBAC: Authorizing `identity:get_user(user_id=bb29552893d14786a13563ce1f4515cd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:28.208474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafcb5e-7af8-4437-9068-b03d57be117f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:28.210115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 130/259] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:28 2022] GET /identity/v3/users/bb29552893d14786a13563ce1f4515cd => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:28.217413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafcb5e-7af8-4437-9068-b03d57be117f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:28.280948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da2208-13a8-4008-b81e-1dae4a9458c4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:28.320071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:28.340254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafcb5e-7af8-4437-9068-b03d57be117f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:28.370611 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10166b1-76b5-4a63-b819-2540019e7ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:28.371313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10166b1-76b5-4a63-b819-2540019e7ff9 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:28.371605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10166b1-76b5-4a63-b819-2540019e7ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:28.371933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10166b1-76b5-4a63-b819-2540019e7ff9 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342/users/07a538e76b6a4926bd55a87a8238c691/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:28.373824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10166b1-76b5-4a63-b819-2540019e7ff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=92436548309e4b6f9ccf5357c5fb8342, user_id=07a538e76b6a4926bd55a87a8238c691, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:28.381792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10166b1-76b5-4a63-b819-2540019e7ff9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:28.387462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5757af3-649c-4994-a5c9-41334004c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:28.388081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5757af3-649c-4994-a5c9-41334004c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:28.389263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5757af3-649c-4994-a5c9-41334004c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:28.389263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5757af3-649c-4994-a5c9-41334004c6f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:28.416079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 130/260] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:18:28 2022] PUT /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342/users/07a538e76b6a4926bd55a87a8238c691/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:18:28.504908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10166b1-76b5-4a63-b819-2540019e7ff9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:28.535035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5757af3-649c-4994-a5c9-41334004c6f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:28.536781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5757af3-649c-4994-a5c9-41334004c6f1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:28.661761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:28.713760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 131/261] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:28.731959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5757af3-649c-4994-a5c9-41334004c6f1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:28.759519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10166b1-76b5-4a63-b819-2540019e7ff9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:28.841421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:28.874365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14b265-1376-45da-bace-31ad16c63bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:28.875573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14b265-1376-45da-bace-31ad16c63bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:28.876232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14b265-1376-45da-bace-31ad16c63bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:28.876704 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14b265-1376-45da-bace-31ad16c63bb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:28.886681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5757af3-649c-4994-a5c9-41334004c6f1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:28.899664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14b265-1376-45da-bace-31ad16c63bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3e14b265-1376-45da-bace-31ad16c63bb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:28.906059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:28.907047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:28.907835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:28.916234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 131/262] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:28.924587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14b265-1376-45da-bace-31ad16c63bb9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:28.939299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622466d-c7b5-46c6-9ebe-23e863609e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:28.939970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622466d-c7b5-46c6-9ebe-23e863609e81 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:28.940247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622466d-c7b5-46c6-9ebe-23e863609e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:28.940519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622466d-c7b5-46c6-9ebe-23e863609e81 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:28.941717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622466d-c7b5-46c6-9ebe-23e863609e81 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:28.943580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622466d-c7b5-46c6-9ebe-23e863609e81 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:28.949863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 132/263] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:28 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:28.952392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622466d-c7b5-46c6-9ebe-23e863609e81 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:29.052455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:29.105288 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622466d-c7b5-46c6-9ebe-23e863609e81 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:29.154548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1111-da98-49ba-a29e-12c40017a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:29.155487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1111-da98-49ba-a29e-12c40017a224 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:29.155772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1111-da98-49ba-a29e-12c40017a224 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:29.156043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1111-da98-49ba-a29e-12c40017a224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:29.156799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1111-da98-49ba-a29e-12c40017a224 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=92436548309e4b6f9ccf5357c5fb8342, user.id=bb29552893d14786a13563ce1f4515cd) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:29.157114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1111-da98-49ba-a29e-12c40017a224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:29.158610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1111-da98-49ba-a29e-12c40017a224 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:29.166913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 133/264] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:28 2022] GET /identity/v3/role_assignments?user.id=bb29552893d14786a13563ce1f4515cd&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:29.204716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14b265-1376-45da-bace-31ad16c63bb9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:29.267920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4c493-e9ba-414a-ac3c-33f8c6e04866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:29.268538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4c493-e9ba-414a-ac3c-33f8c6e04866 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:29.268814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4c493-e9ba-414a-ac3c-33f8c6e04866 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:29.269081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4c493-e9ba-414a-ac3c-33f8c6e04866 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:29.269761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4c493-e9ba-414a-ac3c-33f8c6e04866 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:29.270070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4c493-e9ba-414a-ac3c-33f8c6e04866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:29.273029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4c493-e9ba-414a-ac3c-33f8c6e04866 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:29.287769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 132/265] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:29.293417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1111-da98-49ba-a29e-12c40017a224 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:29.525362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1111-da98-49ba-a29e-12c40017a224 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:29.549475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:29.576191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d4b3b-298c-488a-a460-a5ae234506af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:29.576854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d4b3b-298c-488a-a460-a5ae234506af None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:29.577135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d4b3b-298c-488a-a460-a5ae234506af None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:29.577406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d4b3b-298c-488a-a460-a5ae234506af None admin] PATH_INFO: `/v3/users/bb29552893d14786a13563ce1f4515cd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:29.580140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d4b3b-298c-488a-a460-a5ae234506af None admin] RBAC: Authorizing `identity:get_user(user_id=bb29552893d14786a13563ce1f4515cd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:29.581624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d4b3b-298c-488a-a460-a5ae234506af None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:29.583860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 134/266] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:29 2022] GET /identity/v3/users/bb29552893d14786a13563ce1f4515cd => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:29.589620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4c493-e9ba-414a-ac3c-33f8c6e04866 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:29.664569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:29.731584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4c493-e9ba-414a-ac3c-33f8c6e04866 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:29.779071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23995a-b1dc-4143-aa35-288103508ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:29.779679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23995a-b1dc-4143-aa35-288103508ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:29.779892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23995a-b1dc-4143-aa35-288103508ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:29.780140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23995a-b1dc-4143-aa35-288103508ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:29.878388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23995a-b1dc-4143-aa35-288103508ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:29.879957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23995a-b1dc-4143-aa35-288103508ff9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:29.890557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c634-2d91-4f76-9cc9-3df63184a46e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:29.890876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c634-2d91-4f76-9cc9-3df63184a46e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:29.891153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c634-2d91-4f76-9cc9-3df63184a46e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:29.892790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 135/267] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:29.898778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21bb42-7f8e-4812-a426-a69ddaee2dbb None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:29.899064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21bb42-7f8e-4812-a426-a69ddaee2dbb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:29.899346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21bb42-7f8e-4812-a426-a69ddaee2dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:29.923913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1a21bb42-7f8e-4812-a426-a69ddaee2dbb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:29.925818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1a21bb42-7f8e-4812-a426-a69ddaee2dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:29.960483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:30.009499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 136/268] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:30.011146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206d5bb-a03e-4a71-8d69-e2a02feb4901 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.011676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206d5bb-a03e-4a71-8d69-e2a02feb4901 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.012164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206d5bb-a03e-4a71-8d69-e2a02feb4901 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.013893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 137/269] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:30.019870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7fe7e-5f41-4625-9397-de0b3d046166 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.020414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7fe7e-5f41-4625-9397-de0b3d046166 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.020952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7fe7e-5f41-4625-9397-de0b3d046166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.027907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 133/270] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:30.033649 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23995a-b1dc-4143-aa35-288103508ff9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:30.042026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1ce7fe7e-5f41-4625-9397-de0b3d046166 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:30.043592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1ce7fe7e-5f41-4625-9397-de0b3d046166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:30.116671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 138/271] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:30.163262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae77d-b272-4693-8510-682959f00dd3 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.163915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae77d-b272-4693-8510-682959f00dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.164018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23995a-b1dc-4143-aa35-288103508ff9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:30.164478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae77d-b272-4693-8510-682959f00dd3 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.166485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 139/272] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:18:30.171140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1021f30-e6af-49ad-b5ce-2984d046adde None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.171681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1021f30-e6af-49ad-b5ce-2984d046adde None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.172217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1021f30-e6af-49ad-b5ce-2984d046adde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.191887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a1021f30-e6af-49ad-b5ce-2984d046adde None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:30.193561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a1021f30-e6af-49ad-b5ce-2984d046adde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:30.201417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f2653-c02d-4c0a-adbe-7f98fb025b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:30.202072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2653-c02d-4c0a-adbe-7f98fb025b42 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.202352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2653-c02d-4c0a-adbe-7f98fb025b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.202624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2653-c02d-4c0a-adbe-7f98fb025b42 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.204105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f2653-c02d-4c0a-adbe-7f98fb025b42 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:30.205458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f2653-c02d-4c0a-adbe-7f98fb025b42 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:30.207600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 134/273] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:30 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:30.213689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f2653-c02d-4c0a-adbe-7f98fb025b42 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:30.232949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:30.275165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:30.312416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 140/274] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:30.319385 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f2653-c02d-4c0a-adbe-7f98fb025b42 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:30.355570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5035c8-f522-470d-97a3-3c4366064f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:30.356192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5035c8-f522-470d-97a3-3c4366064f05 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.356469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5035c8-f522-470d-97a3-3c4366064f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.356740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5035c8-f522-470d-97a3-3c4366064f05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.357548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5035c8-f522-470d-97a3-3c4366064f05 None admin] RBAC: Adding query filter params (role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=92436548309e4b6f9ccf5357c5fb8342, user.id=bb29552893d14786a13563ce1f4515cd) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:30.357860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5035c8-f522-470d-97a3-3c4366064f05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:30.359388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5035c8-f522-470d-97a3-3c4366064f05 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:30.367219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 135/275] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:30 2022] GET /identity/v3/role_assignments?user.id=bb29552893d14786a13563ce1f4515cd&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=2e42b82a17a84744960aa3904ab682cc => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:30.444323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1021f30-e6af-49ad-b5ce-2984d046adde None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:30.459469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5035c8-f522-470d-97a3-3c4366064f05 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:30.599059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1021f30-e6af-49ad-b5ce-2984d046adde None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:30.616283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:30.644891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5035c8-f522-470d-97a3-3c4366064f05 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:30.648199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc8c34-6c98-4195-b468-5f0707231202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:30.649162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc8c34-6c98-4195-b468-5f0707231202 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.649628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc8c34-6c98-4195-b468-5f0707231202 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.650084 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc8c34-6c98-4195-b468-5f0707231202 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.652038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc8c34-6c98-4195-b468-5f0707231202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:30.653778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc8c34-6c98-4195-b468-5f0707231202 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:30.656098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 141/276] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:30.661831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc8c34-6c98-4195-b468-5f0707231202 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:30.690747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ad672-1c54-431d-842a-1c80628ffa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:30.691405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ad672-1c54-431d-842a-1c80628ffa13 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.691684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ad672-1c54-431d-842a-1c80628ffa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.691956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ad672-1c54-431d-842a-1c80628ffa13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.705609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ad672-1c54-431d-842a-1c80628ffa13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f46ad672-1c54-431d-842a-1c80628ffa13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:30.711093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:30.712008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:30.712802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 136/277] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:30.713686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ad672-1c54-431d-842a-1c80628ffa13 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:30.716273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:30.790949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc8c34-6c98-4195-b468-5f0707231202 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:30.827203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ad672-1c54-431d-842a-1c80628ffa13 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:30.830964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4a4c3-1ffb-4f39-8c7a-8dba13325d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:30.831613 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4a4c3-1ffb-4f39-8c7a-8dba13325d4e None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.831863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4a4c3-1ffb-4f39-8c7a-8dba13325d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.832133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4a4c3-1ffb-4f39-8c7a-8dba13325d4e None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.832795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4a4c3-1ffb-4f39-8c7a-8dba13325d4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:30.834594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4a4c3-1ffb-4f39-8c7a-8dba13325d4e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:30.858773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 142/278] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:30 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:18:30.859531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4a4c3-1ffb-4f39-8c7a-8dba13325d4e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:30.877790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a556bb-412a-43d9-8bef-f96d545ceb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:30.879693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a556bb-412a-43d9-8bef-f96d545ceb73 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:30.880336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a556bb-412a-43d9-8bef-f96d545ceb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:30.880858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a556bb-412a-43d9-8bef-f96d545ceb73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:30.894437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:30.901013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a556bb-412a-43d9-8bef-f96d545ceb73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-99a556bb-412a-43d9-8bef-f96d545ceb73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:30.912448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:30.913670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:30.914452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:30.917134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 137/279] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:30.926474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a556bb-412a-43d9-8bef-f96d545ceb73 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:30.993986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:30.999170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4a4c3-1ffb-4f39-8c7a-8dba13325d4e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:31.043899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf526d-142f-42c7-b15b-322ef20297da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:31.044918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf526d-142f-42c7-b15b-322ef20297da None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:31.045416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf526d-142f-42c7-b15b-322ef20297da None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:31.045693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf526d-142f-42c7-b15b-322ef20297da None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:31.046415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf526d-142f-42c7-b15b-322ef20297da None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:31.046756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf526d-142f-42c7-b15b-322ef20297da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:31.048224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf526d-142f-42c7-b15b-322ef20297da None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:31.059539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 143/280] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:31.065435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf526d-142f-42c7-b15b-322ef20297da None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:31.067033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a556bb-412a-43d9-8bef-f96d545ceb73 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:31.119359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2809b89-08d5-4524-a674-732e861cdedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:31.120053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2809b89-08d5-4524-a674-732e861cdedf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:31.120226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2809b89-08d5-4524-a674-732e861cdedf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:31.120487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2809b89-08d5-4524-a674-732e861cdedf None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:31.121164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2809b89-08d5-4524-a674-732e861cdedf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:31.121468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2809b89-08d5-4524-a674-732e861cdedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:31.123137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2809b89-08d5-4524-a674-732e861cdedf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:31.132921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 138/281] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:31.139221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2809b89-08d5-4524-a674-732e861cdedf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:31.213124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf526d-142f-42c7-b15b-322ef20297da None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:31.226158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:31.259312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe038ed-5904-4ba9-af9b-caabf3a32363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:31.260945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe038ed-5904-4ba9-af9b-caabf3a32363 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:31.261454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe038ed-5904-4ba9-af9b-caabf3a32363 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:31.262098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe038ed-5904-4ba9-af9b-caabf3a32363 None admin] PATH_INFO: `/v3/users/07e5db15ffe24a2dafb70232ccac5529` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:31.270336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2809b89-08d5-4524-a674-732e861cdedf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:31.282010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe038ed-5904-4ba9-af9b-caabf3a32363 None admin] RBAC: Authorizing `identity:get_user(user_id=07e5db15ffe24a2dafb70232ccac5529)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:31.284258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe038ed-5904-4ba9-af9b-caabf3a32363 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:31.292849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 144/282] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:31 2022] GET /identity/v3/users/07e5db15ffe24a2dafb70232ccac5529 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:31.294905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe038ed-5904-4ba9-af9b-caabf3a32363 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:31.312571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35e1c3-2058-43a4-921c-a42c268487eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:31.313192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35e1c3-2058-43a4-921c-a42c268487eb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:31.313471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35e1c3-2058-43a4-921c-a42c268487eb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:31.313742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35e1c3-2058-43a4-921c-a42c268487eb None admin] PATH_INFO: `/v3/users/c895c7edc8d947799697246c0c969667` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:31.314955 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35e1c3-2058-43a4-921c-a42c268487eb None admin] RBAC: Authorizing `identity:get_user(user_id=c895c7edc8d947799697246c0c969667)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:31.316436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35e1c3-2058-43a4-921c-a42c268487eb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:31.319665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 139/283] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:31 2022] GET /identity/v3/users/c895c7edc8d947799697246c0c969667 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:31.321645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:31.325431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35e1c3-2058-43a4-921c-a42c268487eb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:31.433440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe038ed-5904-4ba9-af9b-caabf3a32363 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:31.449925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35e1c3-2058-43a4-921c-a42c268487eb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:31.488598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2e5d1-c719-4255-84c4-bed7d6622e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:31.489274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e5d1-c719-4255-84c4-bed7d6622e48 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:31.490362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e5d1-c719-4255-84c4-bed7d6622e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:31.490980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e5d1-c719-4255-84c4-bed7d6622e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:31.491772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2e5d1-c719-4255-84c4-bed7d6622e48 None admin] RBAC: Adding query filter params (role.id=23a0d2d1a0af4ab48d71d9bbf06057db, user.id=07e5db15ffe24a2dafb70232ccac5529, scope.system=all) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:31.492081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2e5d1-c719-4255-84c4-bed7d6622e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:31.493735 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2e5d1-c719-4255-84c4-bed7d6622e48 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:31.499024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:31.503997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 145/284] 10.222.0.78 () {56 vars in 1308 bytes} [Wed Aug 24 03:18:31 2022] GET /identity/v3/role_assignments?user.id=07e5db15ffe24a2dafb70232ccac5529&scope.system=all&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:31.503997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf703b2-1044-4805-9e21-57ac5af8cb0b None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:31.503997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf703b2-1044-4805-9e21-57ac5af8cb0b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:31.503997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf703b2-1044-4805-9e21-57ac5af8cb0b None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:31.503997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 146/285] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:31.511126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772af3-a1db-4763-b480-4d16e4661aeb None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:31.511532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772af3-a1db-4763-b480-4d16e4661aeb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:31.511961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772af3-a1db-4763-b480-4d16e4661aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:31.514053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce4a01-d917-4671-8d07-8331eeebaba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:31.515153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce4a01-d917-4671-8d07-8331eeebaba3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:31.515767 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce4a01-d917-4671-8d07-8331eeebaba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:31.516393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce4a01-d917-4671-8d07-8331eeebaba3 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:31.518011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce4a01-d917-4671-8d07-8331eeebaba3 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:31.527459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce4a01-d917-4671-8d07-8331eeebaba3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:31.530860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 140/286] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:31 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:31.535148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b7772af3-a1db-4763-b480-4d16e4661aeb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:31.536534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b7772af3-a1db-4763-b480-4d16e4661aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:31.537641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce4a01-d917-4671-8d07-8331eeebaba3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:31.625161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 147/287] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:31.743537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce4a01-d917-4671-8d07-8331eeebaba3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:31.788909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8d272-b007-4607-8d43-2d2e9ba9c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:31.789986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8d272-b007-4607-8d43-2d2e9ba9c380 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:31.790462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8d272-b007-4607-8d43-2d2e9ba9c380 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:31.791014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8d272-b007-4607-8d43-2d2e9ba9c380 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342/users/c895c7edc8d947799697246c0c969667/roles/df51cbf6777f4f5990a32ae5d5c1ce0e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:31.793380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8d272-b007-4607-8d43-2d2e9ba9c380 None admin] RBAC: Authorizing `identity:create_grant(project_id=92436548309e4b6f9ccf5357c5fb8342, user_id=c895c7edc8d947799697246c0c969667, role_id=df51cbf6777f4f5990a32ae5d5c1ce0e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:31.795229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8d272-b007-4607-8d43-2d2e9ba9c380 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:31.826156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 141/288] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:18:31 2022] PUT /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342/users/c895c7edc8d947799697246c0c969667/roles/df51cbf6777f4f5990a32ae5d5c1ce0e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:31.915275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7772af3-a1db-4763-b480-4d16e4661aeb None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:31.932335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:32.032968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7772af3-a1db-4763-b480-4d16e4661aeb None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:32.069887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a0020-1262-4c4b-80b2-ac2d47b4e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:32.070539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a0020-1262-4c4b-80b2-ac2d47b4e45d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:32.072084 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a0020-1262-4c4b-80b2-ac2d47b4e45d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:32.072353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a0020-1262-4c4b-80b2-ac2d47b4e45d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:32.084355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a0020-1262-4c4b-80b2-ac2d47b4e45d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6a1a0020-1262-4c4b-80b2-ac2d47b4e45d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:32.089137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:32.090016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:32.090827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 148/289] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:32.096365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8d272-b007-4607-8d43-2d2e9ba9c380 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:32.161561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:32.217786 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8d272-b007-4607-8d43-2d2e9ba9c380 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:32.263651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc2b70-45f8-4082-93dd-9ded85d3a6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:32.264276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc2b70-45f8-4082-93dd-9ded85d3a6ab None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:32.264606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc2b70-45f8-4082-93dd-9ded85d3a6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:32.264875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc2b70-45f8-4082-93dd-9ded85d3a6ab None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:32.265599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc2b70-45f8-4082-93dd-9ded85d3a6ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:32.265903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc2b70-45f8-4082-93dd-9ded85d3a6ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:32.267308 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc2b70-45f8-4082-93dd-9ded85d3a6ab None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:32.276836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 142/290] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:32.282353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a0020-1262-4c4b-80b2-ac2d47b4e45d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:32.377254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:32.405013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a0020-1262-4c4b-80b2-ac2d47b4e45d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:32.447801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79c9a5-5b80-4c80-b0d9-f05b48e3bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:32.449039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79c9a5-5b80-4c80-b0d9-f05b48e3bd2b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:32.449388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79c9a5-5b80-4c80-b0d9-f05b48e3bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:32.449766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79c9a5-5b80-4c80-b0d9-f05b48e3bd2b None admin] PATH_INFO: `/v3/users/07a538e76b6a4926bd55a87a8238c691` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:32.455737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79c9a5-5b80-4c80-b0d9-f05b48e3bd2b None admin] RBAC: Authorizing `identity:get_user(user_id=07a538e76b6a4926bd55a87a8238c691)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:32.457823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79c9a5-5b80-4c80-b0d9-f05b48e3bd2b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:32.460067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 149/291] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:32 2022] GET /identity/v3/users/07a538e76b6a4926bd55a87a8238c691 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:32.472333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc2b70-45f8-4082-93dd-9ded85d3a6ab None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:32.613561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc2b70-45f8-4082-93dd-9ded85d3a6ab None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:32.639270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:32.650513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5b32f-7aaf-4a58-93e1-1917802eecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:32.651170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b32f-7aaf-4a58-93e1-1917802eecfb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:32.651447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b32f-7aaf-4a58-93e1-1917802eecfb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:32.651717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b32f-7aaf-4a58-93e1-1917802eecfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:32.742331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5b32f-7aaf-4a58-93e1-1917802eecfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:32.744272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5b32f-7aaf-4a58-93e1-1917802eecfb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:32.884061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 143/292] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:32.889670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79c9a5-5b80-4c80-b0d9-f05b48e3bd2b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:33.047228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79c9a5-5b80-4c80-b0d9-f05b48e3bd2b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:33.089626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bae37-e0bc-4db3-a570-c8ed86bb3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:33.090281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bae37-e0bc-4db3-a570-c8ed86bb3ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:33.090556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bae37-e0bc-4db3-a570-c8ed86bb3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:33.090854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bae37-e0bc-4db3-a570-c8ed86bb3ae8 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:33.092078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bae37-e0bc-4db3-a570-c8ed86bb3ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:33.093590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bae37-e0bc-4db3-a570-c8ed86bb3ae8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:33.095603 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 150/293] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:32 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:33.101701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5b32f-7aaf-4a58-93e1-1917802eecfb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:33.126208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:33.251211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5b32f-7aaf-4a58-93e1-1917802eecfb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:33.302421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c7bca-6d89-4c32-95d1-0baf547e3797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:33.303183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7bca-6d89-4c32-95d1-0baf547e3797 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:33.303459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7bca-6d89-4c32-95d1-0baf547e3797 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:33.303729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7bca-6d89-4c32-95d1-0baf547e3797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:33.304479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7bca-6d89-4c32-95d1-0baf547e3797 None admin] RBAC: Adding query filter params (role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=92436548309e4b6f9ccf5357c5fb8342, user.id=07a538e76b6a4926bd55a87a8238c691) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:33.304783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7bca-6d89-4c32-95d1-0baf547e3797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:33.306238 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7bca-6d89-4c32-95d1-0baf547e3797 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:33.313311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 144/294] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:33 2022] GET /identity/v3/role_assignments?user.id=07a538e76b6a4926bd55a87a8238c691&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:33.554895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6344-8dea-464e-a0ef-c701e64427b2 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:33.555985 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6344-8dea-464e-a0ef-c701e64427b2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:33.556595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6344-8dea-464e-a0ef-c701e64427b2 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:33.558370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 151/295] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:33.569871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad03ea-4769-458d-97e3-fd2259c90971 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:33.570295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad03ea-4769-458d-97e3-fd2259c90971 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:33.570550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad03ea-4769-458d-97e3-fd2259c90971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:33.613483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-30ad03ea-4769-458d-97e3-fd2259c90971 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:33.614964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-30ad03ea-4769-458d-97e3-fd2259c90971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:33.700478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 145/296] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:33.842026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170cc21-9c40-4d6b-afe8-6e9caa093381 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:33.842639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170cc21-9c40-4d6b-afe8-6e9caa093381 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:33.843159 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170cc21-9c40-4d6b-afe8-6e9caa093381 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:33.845027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 152/297] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:33.851772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf90df-cb47-429c-98c4-61512416641a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:33.852414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf90df-cb47-429c-98c4-61512416641a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:33.852883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf90df-cb47-429c-98c4-61512416641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:33.873502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7bbf90df-cb47-429c-98c4-61512416641a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:33.875112 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7bbf90df-cb47-429c-98c4-61512416641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:33.887477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:33.964296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 146/298] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:33.994326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167585f9-5a60-4409-8cad-fdf341d15744 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:33.994995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167585f9-5a60-4409-8cad-fdf341d15744 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:33.995496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167585f9-5a60-4409-8cad-fdf341d15744 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:33.996773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf90df-cb47-429c-98c4-61512416641a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:33.997296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 153/299] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:34.003026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20253e7-97f7-4847-ac3a-a3f302477130 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.003398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20253e7-97f7-4847-ac3a-a3f302477130 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.003549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20253e7-97f7-4847-ac3a-a3f302477130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.024942 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f20253e7-97f7-4847-ac3a-a3f302477130 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:34.026257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f20253e7-97f7-4847-ac3a-a3f302477130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:34.031013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:34.124448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf90df-cb47-429c-98c4-61512416641a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:34.139338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 154/300] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:34.161304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c467a-50f2-4581-a40e-96b8ff834f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:34.161964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c467a-50f2-4581-a40e-96b8ff834f42 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.162287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c467a-50f2-4581-a40e-96b8ff834f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.162630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c467a-50f2-4581-a40e-96b8ff834f42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.175320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c467a-50f2-4581-a40e-96b8ff834f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f41c467a-50f2-4581-a40e-96b8ff834f42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:34.181662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:34.182573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:34.183557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 147/301] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:18:34.190621 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20253e7-97f7-4847-ac3a-a3f302477130 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:34.265160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c467a-50f2-4581-a40e-96b8ff834f42 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:34.278683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:34.338225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20253e7-97f7-4847-ac3a-a3f302477130 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:34.378367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c772b2c-259e-46dd-8105-8b4b81d6e25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:34.378945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c772b2c-259e-46dd-8105-8b4b81d6e25b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.379217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c772b2c-259e-46dd-8105-8b4b81d6e25b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.379482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c772b2c-259e-46dd-8105-8b4b81d6e25b None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.380257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c772b2c-259e-46dd-8105-8b4b81d6e25b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:34.380560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c772b2c-259e-46dd-8105-8b4b81d6e25b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:34.381428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c467a-50f2-4581-a40e-96b8ff834f42 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:34.381980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c772b2c-259e-46dd-8105-8b4b81d6e25b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:34.388448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:34.393009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 155/302] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:34.398691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c772b2c-259e-46dd-8105-8b4b81d6e25b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:34.424859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06bb04-7800-43ec-860a-eebabfac1424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:34.426241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06bb04-7800-43ec-860a-eebabfac1424 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.426762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06bb04-7800-43ec-860a-eebabfac1424 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.427243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06bb04-7800-43ec-860a-eebabfac1424 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.429114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06bb04-7800-43ec-860a-eebabfac1424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:34.431537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06bb04-7800-43ec-860a-eebabfac1424 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:34.434564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 148/303] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:34.435929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06bb04-7800-43ec-860a-eebabfac1424 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:34.530332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:34.541649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c772b2c-259e-46dd-8105-8b4b81d6e25b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:34.562416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06bb04-7800-43ec-860a-eebabfac1424 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:34.584720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3ca3-1988-4935-8824-37ccb89f79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:34.585361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3ca3-1988-4935-8824-37ccb89f79c4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.585641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3ca3-1988-4935-8824-37ccb89f79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.585912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3ca3-1988-4935-8824-37ccb89f79c4 None admin] PATH_INFO: `/v3/users/49c58998776244b88cf4b55044a7dd70` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.601917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d194-78ca-41cf-9b39-6350c71a2b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:34.602566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d194-78ca-41cf-9b39-6350c71a2b90 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.602876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d194-78ca-41cf-9b39-6350c71a2b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.603145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d194-78ca-41cf-9b39-6350c71a2b90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.604974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb3ca3-1988-4935-8824-37ccb89f79c4 None admin] RBAC: Authorizing `identity:get_user(user_id=49c58998776244b88cf4b55044a7dd70)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:34.606458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb3ca3-1988-4935-8824-37ccb89f79c4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:34.608226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 156/304] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:34 2022] GET /identity/v3/users/49c58998776244b88cf4b55044a7dd70 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:34.609008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3ca3-1988-4935-8824-37ccb89f79c4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:34.622797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9d194-78ca-41cf-9b39-6350c71a2b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-17a9d194-78ca-41cf-9b39-6350c71a2b90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:34.630842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:34.631768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:34.632935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 149/305] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:34.633809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09af3f-aceb-43c1-85f7-3b048faf84e2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.634183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09af3f-aceb-43c1-85f7-3b048faf84e2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.634544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09af3f-aceb-43c1-85f7-3b048faf84e2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.637108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 150/306] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:34.637108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09af3f-aceb-43c1-85f7-3b048faf84e2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:34.684969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:34.733411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3ca3-1988-4935-8824-37ccb89f79c4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:34.766465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09af3f-aceb-43c1-85f7-3b048faf84e2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:34.776978 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe9fb-fee1-4bbf-8877-36d660469e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:34.777848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe9fb-fee1-4bbf-8877-36d660469e93 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.778106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe9fb-fee1-4bbf-8877-36d660469e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.778388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fe9fb-fee1-4bbf-8877-36d660469e93 None admin] PATH_INFO: `/v3/groups` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.779063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe9fb-fee1-4bbf-8877-36d660469e93 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:34.780508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fe9fb-fee1-4bbf-8877-36d660469e93 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:34.797034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 157/307] 10.222.0.78 () {60 vars in 1134 bytes} [Wed Aug 24 03:18:34 2022] POST /identity/v3/groups => generated 229 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:34.797869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe9fb-fee1-4bbf-8877-36d660469e93 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:34.804971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:34.812560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d839f-8e50-4d58-bef1-18ada30c7dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:34.813307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d839f-8e50-4d58-bef1-18ada30c7dde None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.813742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d839f-8e50-4d58-bef1-18ada30c7dde None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.814046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d839f-8e50-4d58-bef1-18ada30c7dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.815427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d839f-8e50-4d58-bef1-18ada30c7dde None admin] RBAC: Adding query filter params (role.id=df51cbf6777f4f5990a32ae5d5c1ce0e, user.id=49c58998776244b88cf4b55044a7dd70, scope.system=all) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:34.815866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d839f-8e50-4d58-bef1-18ada30c7dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:34.817747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d839f-8e50-4d58-bef1-18ada30c7dde None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:34.825125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 151/308] 10.222.0.78 () {56 vars in 1308 bytes} [Wed Aug 24 03:18:34 2022] GET /identity/v3/role_assignments?user.id=49c58998776244b88cf4b55044a7dd70&scope.system=all&role.id=df51cbf6777f4f5990a32ae5d5c1ce0e => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:34.826497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49857ff8-87f3-441f-a69b-aa710008b87a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:34.826834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49857ff8-87f3-441f-a69b-aa710008b87a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:34.827106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49857ff8-87f3-441f-a69b-aa710008b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:34.860161 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-49857ff8-87f3-441f-a69b-aa710008b87a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:34.861749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-49857ff8-87f3-441f-a69b-aa710008b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:34.968193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fe9fb-fee1-4bbf-8877-36d660469e93 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:34.970853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 152/309] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:34.996549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:35.022704 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d85d3-8390-432b-9189-4ee92ed027cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:35.023325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d85d3-8390-432b-9189-4ee92ed027cc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:35.023600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d85d3-8390-432b-9189-4ee92ed027cc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:35.023869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d85d3-8390-432b-9189-4ee92ed027cc None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:35.024553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d85d3-8390-432b-9189-4ee92ed027cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:35.024858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d85d3-8390-432b-9189-4ee92ed027cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:35.026290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d85d3-8390-432b-9189-4ee92ed027cc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:35.040293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 158/310] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:35.046108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49857ff8-87f3-441f-a69b-aa710008b87a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:35.172151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49857ff8-87f3-441f-a69b-aa710008b87a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:35.203244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:35.215929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b19d3f-6c38-4119-9668-8e12ebf4b2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:35.216780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b19d3f-6c38-4119-9668-8e12ebf4b2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:35.217062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b19d3f-6c38-4119-9668-8e12ebf4b2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:35.217376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b19d3f-6c38-4119-9668-8e12ebf4b2e5 None admin] PATH_INFO: `/v3/users/07e5db15ffe24a2dafb70232ccac5529` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:35.218601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b19d3f-6c38-4119-9668-8e12ebf4b2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=07e5db15ffe24a2dafb70232ccac5529)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:35.220002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b19d3f-6c38-4119-9668-8e12ebf4b2e5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:35.221978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 153/311] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:35 2022] GET /identity/v3/users/07e5db15ffe24a2dafb70232ccac5529 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:35.231474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d85d3-8390-432b-9189-4ee92ed027cc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:35.242606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b19d3f-6c38-4119-9668-8e12ebf4b2e5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:35.378777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d85d3-8390-432b-9189-4ee92ed027cc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:35.379751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b19d3f-6c38-4119-9668-8e12ebf4b2e5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:35.425670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd870-7f8f-475e-8864-43ec42d4b5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:35.426313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd870-7f8f-475e-8864-43ec42d4b5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:35.426580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd870-7f8f-475e-8864-43ec42d4b5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:35.426975 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd870-7f8f-475e-8864-43ec42d4b5d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:35.441126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd168cab-6571-422e-bdbe-fb13ba6ae58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:35.442176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd168cab-6571-422e-bdbe-fb13ba6ae58a None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:35.442382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dd870-7f8f-475e-8864-43ec42d4b5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:35.443482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd168cab-6571-422e-bdbe-fb13ba6ae58a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:35.443954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd168cab-6571-422e-bdbe-fb13ba6ae58a None admin] PATH_INFO: `/v3/system/users/07e5db15ffe24a2dafb70232ccac5529/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:35.445811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd168cab-6571-422e-bdbe-fb13ba6ae58a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=07e5db15ffe24a2dafb70232ccac5529, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-524dd870-7f8f-475e-8864-43ec42d4b5d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:35.447258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:35.448479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:35.449260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 154/312] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:18:35.450749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd168cab-6571-422e-bdbe-fb13ba6ae58a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:35.462705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd870-7f8f-475e-8864-43ec42d4b5d5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:35.463499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 159/313] 10.222.0.78 () {58 vars in 1334 bytes} [Wed Aug 24 03:18:35 2022] PUT /identity/v3/system/users/07e5db15ffe24a2dafb70232ccac5529/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:35.542158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:35.595541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd870-7f8f-475e-8864-43ec42d4b5d5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:35.634238 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453aa98-d317-46e0-a286-6ce80f531c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:35.634900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453aa98-d317-46e0-a286-6ce80f531c3c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:35.635179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453aa98-d317-46e0-a286-6ce80f531c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:35.635450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453aa98-d317-46e0-a286-6ce80f531c3c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:35.636145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453aa98-d317-46e0-a286-6ce80f531c3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:35.636450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453aa98-d317-46e0-a286-6ce80f531c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:35.637886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453aa98-d317-46e0-a286-6ce80f531c3c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:35.648274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 155/314] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:35.657295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd168cab-6571-422e-bdbe-fb13ba6ae58a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:35.726174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:35.796040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd168cab-6571-422e-bdbe-fb13ba6ae58a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:35.835264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d52b6-109b-4614-9126-42d1d19364c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:35.835982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d52b6-109b-4614-9126-42d1d19364c8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:35.836264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d52b6-109b-4614-9126-42d1d19364c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:35.836535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d52b6-109b-4614-9126-42d1d19364c8 None admin] PATH_INFO: `/v3/users/c895c7edc8d947799697246c0c969667` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:35.837802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d52b6-109b-4614-9126-42d1d19364c8 None admin] RBAC: Authorizing `identity:get_user(user_id=c895c7edc8d947799697246c0c969667)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:35.839315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d52b6-109b-4614-9126-42d1d19364c8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:35.845763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 160/315] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:35 2022] GET /identity/v3/users/c895c7edc8d947799697246c0c969667 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:35.847290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453aa98-d317-46e0-a286-6ce80f531c3c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:35.968461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453aa98-d317-46e0-a286-6ce80f531c3c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:35.988080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:36.008657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21301021-3b4d-45cc-8d98-77a31a855480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:36.009286 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21301021-3b4d-45cc-8d98-77a31a855480 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:36.009565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21301021-3b4d-45cc-8d98-77a31a855480 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:36.009838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21301021-3b4d-45cc-8d98-77a31a855480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:36.087555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21301021-3b4d-45cc-8d98-77a31a855480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:36.088959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21301021-3b4d-45cc-8d98-77a31a855480 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:36.195728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 156/316] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:36.204011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d52b6-109b-4614-9126-42d1d19364c8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:36.322347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d52b6-109b-4614-9126-42d1d19364c8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:36.340507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:36.360679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f7d2-4dbb-4361-b93b-49c950b75967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:36.361331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f7d2-4dbb-4361-b93b-49c950b75967 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:36.361611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f7d2-4dbb-4361-b93b-49c950b75967 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:36.361884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f7d2-4dbb-4361-b93b-49c950b75967 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:36.363150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f7d2-4dbb-4361-b93b-49c950b75967 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:36.364670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f7d2-4dbb-4361-b93b-49c950b75967 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:36.366358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 161/317] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:36 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:36.372476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21301021-3b4d-45cc-8d98-77a31a855480 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:36.391500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:36.496926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21301021-3b4d-45cc-8d98-77a31a855480 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:36.537706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b44e1-517e-4e5a-8b1a-a12291a7d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:36.538365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b44e1-517e-4e5a-8b1a-a12291a7d846 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:36.538717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b44e1-517e-4e5a-8b1a-a12291a7d846 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:36.539014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b44e1-517e-4e5a-8b1a-a12291a7d846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:36.539823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b44e1-517e-4e5a-8b1a-a12291a7d846 None admin] RBAC: Adding query filter params (role.id=df51cbf6777f4f5990a32ae5d5c1ce0e, scope.project.id=92436548309e4b6f9ccf5357c5fb8342, user.id=c895c7edc8d947799697246c0c969667) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:36.540170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b44e1-517e-4e5a-8b1a-a12291a7d846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:36.541763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b44e1-517e-4e5a-8b1a-a12291a7d846 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:36.548873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 157/318] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:18:36 2022] GET /identity/v3/role_assignments?user.id=c895c7edc8d947799697246c0c969667&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=df51cbf6777f4f5990a32ae5d5c1ce0e => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:36.838837 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60de8bd-023f-4d65-bbbf-00b910cc2774 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:36.839363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60de8bd-023f-4d65-bbbf-00b910cc2774 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:36.839363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60de8bd-023f-4d65-bbbf-00b910cc2774 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:36.840951 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 162/319] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:36.846243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb19ead-dd19-4111-9efc-ddec61a20f7e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:36.846522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb19ead-dd19-4111-9efc-ddec61a20f7e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:36.846875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb19ead-dd19-4111-9efc-ddec61a20f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:36.875294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8fb19ead-dd19-4111-9efc-ddec61a20f7e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:36.877180 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8fb19ead-dd19-4111-9efc-ddec61a20f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:36.954162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 158/320] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:37.007272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a702056-9292-4356-abbe-cc63fd17e584 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:37.007619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a702056-9292-4356-abbe-cc63fd17e584 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:37.007804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a702056-9292-4356-abbe-cc63fd17e584 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:37.009325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 163/321] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:37.014454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c34a-affa-45d1-8ee8-8c2c6439e013 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:37.014776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c34a-affa-45d1-8ee8-8c2c6439e013 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:37.015056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092c34a-affa-45d1-8ee8-8c2c6439e013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:37.033968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e092c34a-affa-45d1-8ee8-8c2c6439e013 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:37.035186 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e092c34a-affa-45d1-8ee8-8c2c6439e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:37.038213 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:37.116467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 159/322] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:37.228383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a702056-9292-4356-abbe-cc63fd17e584 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:37.350981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a702056-9292-4356-abbe-cc63fd17e584 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:37.378739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092c34a-affa-45d1-8ee8-8c2c6439e013 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:37.386312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41542f-a9d6-43e5-9178-88fa474ff065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:37.387492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41542f-a9d6-43e5-9178-88fa474ff065 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:37.387826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41542f-a9d6-43e5-9178-88fa474ff065 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:37.388107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41542f-a9d6-43e5-9178-88fa474ff065 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:37.401483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41542f-a9d6-43e5-9178-88fa474ff065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4c41542f-a9d6-43e5-9178-88fa474ff065 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:37.408367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:37.409336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:37.410112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 164/323] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:37.415754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41542f-a9d6-43e5-9178-88fa474ff065 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:37.466474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:37.495138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092c34a-affa-45d1-8ee8-8c2c6439e013 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:37.539828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00ff7-de7c-44e1-9e19-6337168fc8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:37.540763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00ff7-de7c-44e1-9e19-6337168fc8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:37.541076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00ff7-de7c-44e1-9e19-6337168fc8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:37.541350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00ff7-de7c-44e1-9e19-6337168fc8a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:37.542581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec00ff7-de7c-44e1-9e19-6337168fc8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:37.544087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec00ff7-de7c-44e1-9e19-6337168fc8a0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:37.546744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 160/324] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:37.546888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41542f-a9d6-43e5-9178-88fa474ff065 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:37.551785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00ff7-de7c-44e1-9e19-6337168fc8a0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:37.563129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:37.587798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcb6ac-e5a5-4cf1-ada3-799a5f386113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:37.588407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb6ac-e5a5-4cf1-ada3-799a5f386113 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:37.588677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb6ac-e5a5-4cf1-ada3-799a5f386113 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:37.588938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb6ac-e5a5-4cf1-ada3-799a5f386113 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:37.589611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcb6ac-e5a5-4cf1-ada3-799a5f386113 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:37.589908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcb6ac-e5a5-4cf1-ada3-799a5f386113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:37.593905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcb6ac-e5a5-4cf1-ada3-799a5f386113 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:37.609544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 165/325] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:37.609544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202053-f419-4927-b237-6594db5120d4 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:37.609544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202053-f419-4927-b237-6594db5120d4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:37.609544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202053-f419-4927-b237-6594db5120d4 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:37.611667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 166/326] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:37.612319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202053-f419-4927-b237-6594db5120d4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:37.664675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00ff7-de7c-44e1-9e19-6337168fc8a0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:37.700653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3dd10-db13-4243-bbf6-588ed6f97447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:37.701822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3dd10-db13-4243-bbf6-588ed6f97447 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:37.701822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3dd10-db13-4243-bbf6-588ed6f97447 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:37.701822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3dd10-db13-4243-bbf6-588ed6f97447 None admin] PATH_INFO: `/v3/groups` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:37.702425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3dd10-db13-4243-bbf6-588ed6f97447 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:37.703936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3dd10-db13-4243-bbf6-588ed6f97447 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:37.722048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 161/327] 10.222.0.78 () {60 vars in 1134 bytes} [Wed Aug 24 03:18:37 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:37.732733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b275d-6895-437a-906c-e81fa9344797 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:37.732733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b275d-6895-437a-906c-e81fa9344797 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:37.732733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b275d-6895-437a-906c-e81fa9344797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:37.734858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202053-f419-4927-b237-6594db5120d4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:37.737804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:37.751178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-546b275d-6895-437a-906c-e81fa9344797 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:37.752326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-546b275d-6895-437a-906c-e81fa9344797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:37.794402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd06e6b-3e44-46a6-bcb1-87cd15acd0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:37.795404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd06e6b-3e44-46a6-bcb1-87cd15acd0cd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:37.795860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd06e6b-3e44-46a6-bcb1-87cd15acd0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:37.796340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd06e6b-3e44-46a6-bcb1-87cd15acd0cd None admin] PATH_INFO: `/v3/users/49c58998776244b88cf4b55044a7dd70` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:37.797977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd06e6b-3e44-46a6-bcb1-87cd15acd0cd None admin] RBAC: Authorizing `identity:get_user(user_id=49c58998776244b88cf4b55044a7dd70)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:37.800488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd06e6b-3e44-46a6-bcb1-87cd15acd0cd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:37.809080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 167/328] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:37 2022] GET /identity/v3/users/49c58998776244b88cf4b55044a7dd70 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:37.810763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd06e6b-3e44-46a6-bcb1-87cd15acd0cd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:37.844582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:37.858760 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 162/329] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:37.984685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd06e6b-3e44-46a6-bcb1-87cd15acd0cd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:38.045408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8d7b9-9261-444b-aa15-efa6c2530755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:38.046001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8d7b9-9261-444b-aa15-efa6c2530755 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:38.046275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8d7b9-9261-444b-aa15-efa6c2530755 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:38.046546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8d7b9-9261-444b-aa15-efa6c2530755 None admin] PATH_INFO: `/v3/system/users/49c58998776244b88cf4b55044a7dd70/roles/df51cbf6777f4f5990a32ae5d5c1ce0e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:38.048121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8d7b9-9261-444b-aa15-efa6c2530755 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=49c58998776244b88cf4b55044a7dd70, role_id=df51cbf6777f4f5990a32ae5d5c1ce0e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:38.049506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8d7b9-9261-444b-aa15-efa6c2530755 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:38.060110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 168/330] 10.222.0.78 () {58 vars in 1334 bytes} [Wed Aug 24 03:18:37 2022] PUT /identity/v3/system/users/49c58998776244b88cf4b55044a7dd70/roles/df51cbf6777f4f5990a32ae5d5c1ce0e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:38.159015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b275d-6895-437a-906c-e81fa9344797 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:38.303296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b275d-6895-437a-906c-e81fa9344797 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:38.348354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d5598-ecf5-46eb-8a5f-18b76e2360c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:38.349642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5598-ecf5-46eb-8a5f-18b76e2360c5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:38.350103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5598-ecf5-46eb-8a5f-18b76e2360c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:38.350561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5598-ecf5-46eb-8a5f-18b76e2360c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:38.367547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d5598-ecf5-46eb-8a5f-18b76e2360c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b97d5598-ecf5-46eb-8a5f-18b76e2360c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:38.372617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:38.373518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:38.374521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 163/331] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:38.381927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8d7b9-9261-444b-aa15-efa6c2530755 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:38.439106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:38.573733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8d7b9-9261-444b-aa15-efa6c2530755 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:38.634269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fbf3e-63d7-4930-a312-d354a1c59124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:38.638736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fbf3e-63d7-4930-a312-d354a1c59124 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:38.638736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fbf3e-63d7-4930-a312-d354a1c59124 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:38.638736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fbf3e-63d7-4930-a312-d354a1c59124 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:38.638736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fbf3e-63d7-4930-a312-d354a1c59124 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:38.638736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fbf3e-63d7-4930-a312-d354a1c59124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:38.638736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fbf3e-63d7-4930-a312-d354a1c59124 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:38.648936 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 169/332] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:38.655146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d5598-ecf5-46eb-8a5f-18b76e2360c5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:38.727512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:38.774178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d5598-ecf5-46eb-8a5f-18b76e2360c5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:38.815842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8a7a0-ca96-4a40-aa3d-6074fb33f379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:38.816880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8a7a0-ca96-4a40-aa3d-6074fb33f379 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:38.817765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8a7a0-ca96-4a40-aa3d-6074fb33f379 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:38.818047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8a7a0-ca96-4a40-aa3d-6074fb33f379 None admin] PATH_INFO: `/v3/users/07e5db15ffe24a2dafb70232ccac5529` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:38.819503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8a7a0-ca96-4a40-aa3d-6074fb33f379 None admin] RBAC: Authorizing `identity:get_user(user_id=07e5db15ffe24a2dafb70232ccac5529)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:38.820995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8a7a0-ca96-4a40-aa3d-6074fb33f379 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:38.824061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 164/333] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:38 2022] GET /identity/v3/users/07e5db15ffe24a2dafb70232ccac5529 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:38.831653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fbf3e-63d7-4930-a312-d354a1c59124 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:38.991313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:39.005861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fbf3e-63d7-4930-a312-d354a1c59124 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:39.083909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cbeea-2b51-4787-bcbe-f946dc800fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:39.084786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cbeea-2b51-4787-bcbe-f946dc800fdb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:39.085230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cbeea-2b51-4787-bcbe-f946dc800fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:39.085663 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cbeea-2b51-4787-bcbe-f946dc800fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:39.086902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cbeea-2b51-4787-bcbe-f946dc800fdb None admin] RBAC: Adding query filter params (role.id=23a0d2d1a0af4ab48d71d9bbf06057db, user.id=07e5db15ffe24a2dafb70232ccac5529, scope.system=all) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:39.087394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cbeea-2b51-4787-bcbe-f946dc800fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:39.089906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cbeea-2b51-4787-bcbe-f946dc800fdb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:39.113769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 170/334] 10.222.0.78 () {56 vars in 1308 bytes} [Wed Aug 24 03:18:38 2022] GET /identity/v3/role_assignments?user.id=07e5db15ffe24a2dafb70232ccac5529&scope.system=all&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 510 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:40.442452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01bd0e-618b-4209-b5d3-8bfb2a24fc9f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:40.443070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01bd0e-618b-4209-b5d3-8bfb2a24fc9f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:40.443070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01bd0e-618b-4209-b5d3-8bfb2a24fc9f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:40.444835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 165/335] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:40.449353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c8047-f64d-4701-9cdb-3a6d5efe2002 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:40.450312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c8047-f64d-4701-9cdb-3a6d5efe2002 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:40.450813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c8047-f64d-4701-9cdb-3a6d5efe2002 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:40.452831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 171/336] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:40.457035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e4eb-36ef-4107-9087-50ec6ee8c3a9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:40.457607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e4eb-36ef-4107-9087-50ec6ee8c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:40.458120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e4eb-36ef-4107-9087-50ec6ee8c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:40.463178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f09ee-7c94-4dff-a2dc-542cd086c026 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:40.464320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f09ee-7c94-4dff-a2dc-542cd086c026 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:40.466016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f09ee-7c94-4dff-a2dc-542cd086c026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:40.486500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-96e3e4eb-36ef-4107-9087-50ec6ee8c3a9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:40.489181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-96e3e4eb-36ef-4107-9087-50ec6ee8c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:40.495636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6a0f09ee-7c94-4dff-a2dc-542cd086c026 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:40.496946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6a0f09ee-7c94-4dff-a2dc-542cd086c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:40.598118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 166/337] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:40.600695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb686f-660c-4dfc-82dd-b7f825ef4293 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:40.601226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb686f-660c-4dfc-82dd-b7f825ef4293 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:40.602491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb686f-660c-4dfc-82dd-b7f825ef4293 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:40.604193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 167/338] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:40.611792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e381f0-778e-4bd8-9afb-936fc05ea3f1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:40.614678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e381f0-778e-4bd8-9afb-936fc05ea3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:40.614678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e381f0-778e-4bd8-9afb-936fc05ea3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:40.658612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 172/339] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:40.659578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-13e381f0-778e-4bd8-9afb-936fc05ea3f1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:40.660810 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-13e381f0-778e-4bd8-9afb-936fc05ea3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:40.737264 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:40.764759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 168/340] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:40.904517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f09ee-7c94-4dff-a2dc-542cd086c026 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:41.011051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:41.028460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f09ee-7c94-4dff-a2dc-542cd086c026 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:41.079434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34896131-2c64-43e3-a7a8-d7ffff7c50fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:41.080477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34896131-2c64-43e3-a7a8-d7ffff7c50fd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:41.080979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34896131-2c64-43e3-a7a8-d7ffff7c50fd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:41.081454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34896131-2c64-43e3-a7a8-d7ffff7c50fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:41.093362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34896131-2c64-43e3-a7a8-d7ffff7c50fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-34896131-2c64-43e3-a7a8-d7ffff7c50fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:41.098590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:41.103331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:18:41.104149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:41.106816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 173/341] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:41.112974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e381f0-778e-4bd8-9afb-936fc05ea3f1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:41.136564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34896131-2c64-43e3-a7a8-d7ffff7c50fd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:41.239139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e381f0-778e-4bd8-9afb-936fc05ea3f1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:41.296601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ecc45-9d8d-4c21-99a6-bfb5dc205509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:41.297142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ecc45-9d8d-4c21-99a6-bfb5dc205509 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:41.297421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ecc45-9d8d-4c21-99a6-bfb5dc205509 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:41.297691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ecc45-9d8d-4c21-99a6-bfb5dc205509 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:41.298386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ecc45-9d8d-4c21-99a6-bfb5dc205509 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:41.298709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ecc45-9d8d-4c21-99a6-bfb5dc205509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:41.302681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ecc45-9d8d-4c21-99a6-bfb5dc205509 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:41.315286 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 169/342] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:41.316181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ecc45-9d8d-4c21-99a6-bfb5dc205509 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:41.352350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34896131-2c64-43e3-a7a8-d7ffff7c50fd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:41.381769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:41.440596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ecc45-9d8d-4c21-99a6-bfb5dc205509 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:41.455756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191d9cd-372b-44cf-a982-dda9a4b9206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:41.456416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191d9cd-372b-44cf-a982-dda9a4b9206d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:41.456692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191d9cd-372b-44cf-a982-dda9a4b9206d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:41.456966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191d9cd-372b-44cf-a982-dda9a4b9206d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:41.485129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191d9cd-372b-44cf-a982-dda9a4b9206d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-0191d9cd-372b-44cf-a982-dda9a4b9206d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:41.491071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:41.491999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:41.492786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:41.498367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 174/343] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:18:41.499472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191d9cd-372b-44cf-a982-dda9a4b9206d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:41.507329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:41.509320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0469-69d7-48dc-b7e6-d59051a3369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:41.509982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0469-69d7-48dc-b7e6-d59051a3369b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:41.510259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0469-69d7-48dc-b7e6-d59051a3369b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:41.510530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0469-69d7-48dc-b7e6-d59051a3369b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:41.523585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd0469-69d7-48dc-b7e6-d59051a3369b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-88dd0469-69d7-48dc-b7e6-d59051a3369b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:41.531291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:41.532470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:41.533387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 170/344] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:41.534233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0469-69d7-48dc-b7e6-d59051a3369b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:41.662686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0469-69d7-48dc-b7e6-d59051a3369b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:41.675224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:41.703441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8eb8-3eee-40c0-aeda-e52b783132bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:41.704626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8eb8-3eee-40c0-aeda-e52b783132bf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:41.704626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8eb8-3eee-40c0-aeda-e52b783132bf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:41.704626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8eb8-3eee-40c0-aeda-e52b783132bf None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:41.705260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8eb8-3eee-40c0-aeda-e52b783132bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:41.705560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8eb8-3eee-40c0-aeda-e52b783132bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:41.706993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8eb8-3eee-40c0-aeda-e52b783132bf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:41.719480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 171/345] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:41.720372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8eb8-3eee-40c0-aeda-e52b783132bf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:41.783120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191d9cd-372b-44cf-a982-dda9a4b9206d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:41.829542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0179-480e-4b7e-8cc6-0e67e69bb4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:41.830184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0179-480e-4b7e-8cc6-0e67e69bb4ed None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:41.830458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0179-480e-4b7e-8cc6-0e67e69bb4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:41.831398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0179-480e-4b7e-8cc6-0e67e69bb4ed None admin] PATH_INFO: `/v3/users/49c58998776244b88cf4b55044a7dd70` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:41.832971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0179-480e-4b7e-8cc6-0e67e69bb4ed None admin] RBAC: Authorizing `identity:get_user(user_id=49c58998776244b88cf4b55044a7dd70)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:41.834833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0179-480e-4b7e-8cc6-0e67e69bb4ed None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:41.836956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 175/346] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:18:41 2022] GET /identity/v3/users/49c58998776244b88cf4b55044a7dd70 => generated 293 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:41.837989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0179-480e-4b7e-8cc6-0e67e69bb4ed None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:41.861935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8eb8-3eee-40c0-aeda-e52b783132bf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:41.916580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfbe84-8a80-4fac-b9f4-30124ba1eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:41.917232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfbe84-8a80-4fac-b9f4-30124ba1eaaf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:41.917504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfbe84-8a80-4fac-b9f4-30124ba1eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:41.917854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfbe84-8a80-4fac-b9f4-30124ba1eaaf None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:41.919031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfbe84-8a80-4fac-b9f4-30124ba1eaaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:41.919494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfbe84-8a80-4fac-b9f4-30124ba1eaaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:41.920967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfbe84-8a80-4fac-b9f4-30124ba1eaaf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:41.934388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 172/347] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:41.937124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55646db0-2167-44ab-80a4-6d7437031bb6 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:41.937510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55646db0-2167-44ab-80a4-6d7437031bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:41.937948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55646db0-2167-44ab-80a4-6d7437031bb6 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:41.939052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:41.940315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 173/348] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:41.941393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55646db0-2167-44ab-80a4-6d7437031bb6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:41.984951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:41.993138 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0179-480e-4b7e-8cc6-0e67e69bb4ed None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:42.053656 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49f5a-8031-4082-a706-fe936f374b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:42.054773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49f5a-8031-4082-a706-fe936f374b8d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:42.055272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49f5a-8031-4082-a706-fe936f374b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:42.055886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49f5a-8031-4082-a706-fe936f374b8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:42.107624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55646db0-2167-44ab-80a4-6d7437031bb6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:42.160065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0c191-12c6-4da8-a5f3-82e93670307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:42.160693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0c191-12c6-4da8-a5f3-82e93670307d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:42.161005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0c191-12c6-4da8-a5f3-82e93670307d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:42.161272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0c191-12c6-4da8-a5f3-82e93670307d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:42.162019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0c191-12c6-4da8-a5f3-82e93670307d None admin] RBAC: Adding query filter params (role.id=df51cbf6777f4f5990a32ae5d5c1ce0e, user.id=49c58998776244b88cf4b55044a7dd70, scope.system=all) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:42.162320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0c191-12c6-4da8-a5f3-82e93670307d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:42.163730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea49f5a-8031-4082-a706-fe936f374b8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:42.163868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0c191-12c6-4da8-a5f3-82e93670307d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:42.165903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea49f5a-8031-4082-a706-fe936f374b8d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:42.180650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 174/349] 10.222.0.78 () {56 vars in 1308 bytes} [Wed Aug 24 03:18:41 2022] GET /identity/v3/role_assignments?user.id=49c58998776244b88cf4b55044a7dd70&scope.system=all&role.id=df51cbf6777f4f5990a32ae5d5c1ce0e => generated 510 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:42.181510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0c191-12c6-4da8-a5f3-82e93670307d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:42.261484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:42.300327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 176/350] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:42.302936 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0891994-b72a-4843-b5c9-9b6473273456 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:42.303447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0891994-b72a-4843-b5c9-9b6473273456 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:42.303938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0891994-b72a-4843-b5c9-9b6473273456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:42.324879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:42.336945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d0891994-b72a-4843-b5c9-9b6473273456 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:42.338240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d0891994-b72a-4843-b5c9-9b6473273456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:42.355477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0c191-12c6-4da8-a5f3-82e93670307d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:42.437183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e30e44-f340-4502-b6f7-5411f2cbfb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:42.437815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e30e44-f340-4502-b6f7-5411f2cbfb48 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:42.438095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e30e44-f340-4502-b6f7-5411f2cbfb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:42.438365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e30e44-f340-4502-b6f7-5411f2cbfb48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:42.482588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 177/351] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:42.483570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0891994-b72a-4843-b5c9-9b6473273456 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:42.557519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e30e44-f340-4502-b6f7-5411f2cbfb48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:42.559890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e30e44-f340-4502-b6f7-5411f2cbfb48 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:42.613053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0891994-b72a-4843-b5c9-9b6473273456 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:42.618710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:42.675134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa90577-27a6-4510-b4f0-bac0e9fadd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:42.676800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90577-27a6-4510-b4f0-bac0e9fadd32 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:42.677459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90577-27a6-4510-b4f0-bac0e9fadd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:42.677892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90577-27a6-4510-b4f0-bac0e9fadd32 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:42.680213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa90577-27a6-4510-b4f0-bac0e9fadd32 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:42.683120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa90577-27a6-4510-b4f0-bac0e9fadd32 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:42.685235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 178/352] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:42 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:42.694289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa90577-27a6-4510-b4f0-bac0e9fadd32 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:42.759109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:42.777658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 175/353] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:42.780013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504b61-e8b3-4934-ae23-8195080cd4d5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:42.780296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504b61-e8b3-4934-ae23-8195080cd4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:42.780559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504b61-e8b3-4934-ae23-8195080cd4d5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:42.781843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 176/354] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:42.785464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd504b61-e8b3-4934-ae23-8195080cd4d5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:42.852869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa90577-27a6-4510-b4f0-bac0e9fadd32 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:42.892454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45754373-5ae7-4bdc-a9a0-1e38cfc1af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:42.893253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45754373-5ae7-4bdc-a9a0-1e38cfc1af3a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:42.893526 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45754373-5ae7-4bdc-a9a0-1e38cfc1af3a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:42.894092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45754373-5ae7-4bdc-a9a0-1e38cfc1af3a None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:42.901713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45754373-5ae7-4bdc-a9a0-1e38cfc1af3a None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:42.903916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45754373-5ae7-4bdc-a9a0-1e38cfc1af3a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:42.906697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 179/355] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:42 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:42.906697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c850660-b8f5-464a-a793-21a3a91bc3f8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:42.906697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c850660-b8f5-464a-a793-21a3a91bc3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:42.906962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c850660-b8f5-464a-a793-21a3a91bc3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:42.917690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd504b61-e8b3-4934-ae23-8195080cd4d5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:42.928371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-4c850660-b8f5-464a-a793-21a3a91bc3f8 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:42.930170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4c850660-b8f5-464a-a793-21a3a91bc3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:42.971590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:42.996749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec882c-a2cd-4a7f-a732-48701f1cb475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:42.998155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec882c-a2cd-4a7f-a732-48701f1cb475 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:42.998155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec882c-a2cd-4a7f-a732-48701f1cb475 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:42.998155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec882c-a2cd-4a7f-a732-48701f1cb475 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:43.000019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec882c-a2cd-4a7f-a732-48701f1cb475 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:43.002706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec882c-a2cd-4a7f-a732-48701f1cb475 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:43.004656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 177/356] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:42 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:43.004862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec882c-a2cd-4a7f-a732-48701f1cb475 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:43.036066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 180/357] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:43.037785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c850660-b8f5-464a-a793-21a3a91bc3f8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:43.092666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:43.155968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec882c-a2cd-4a7f-a732-48701f1cb475 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:43.199986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c850660-b8f5-464a-a793-21a3a91bc3f8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:43.205860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f168d-b13b-47db-947c-493c3ba10314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:43.206489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f168d-b13b-47db-947c-493c3ba10314 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:43.206805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f168d-b13b-47db-947c-493c3ba10314 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:43.207070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f168d-b13b-47db-947c-493c3ba10314 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:43.225645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f168d-b13b-47db-947c-493c3ba10314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-219f168d-b13b-47db-947c-493c3ba10314 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:43.231299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:43.232211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:43.233065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 178/358] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:43.234349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f168d-b13b-47db-947c-493c3ba10314 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:43.261327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde3fae-d577-4e0d-92da-0973a51c5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:43.261958 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3fae-d577-4e0d-92da-0973a51c5a0e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:43.262232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3fae-d577-4e0d-92da-0973a51c5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:43.262501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3fae-d577-4e0d-92da-0973a51c5a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:43.263296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde3fae-d577-4e0d-92da-0973a51c5a0e None admin] RBAC: Adding query filter params (group.id=c2af1b3f513f47208dc1d8e0b9f72799, role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=5155bcda0dce418e98bae20b53135115) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:43.263600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde3fae-d577-4e0d-92da-0973a51c5a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:43.265095 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde3fae-d577-4e0d-92da-0973a51c5a0e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:43.277959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 181/359] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:43 2022] GET /identity/v3/role_assignments?group.id=c2af1b3f513f47208dc1d8e0b9f72799&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:43.277959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe960edd-53a2-469f-a658-49abfd111b94 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:43.277959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe960edd-53a2-469f-a658-49abfd111b94 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:43.277959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe960edd-53a2-469f-a658-49abfd111b94 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:43.279937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 182/360] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:43.280756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe960edd-53a2-469f-a658-49abfd111b94 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:43.324179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:43.387294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f168d-b13b-47db-947c-493c3ba10314 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:43.417216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:43.446932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe960edd-53a2-469f-a658-49abfd111b94 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:43.461205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca202184-49cb-4e19-bb50-8ae37d4e26ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:43.461985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202184-49cb-4e19-bb50-8ae37d4e26ad None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:43.462317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202184-49cb-4e19-bb50-8ae37d4e26ad None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:43.462591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202184-49cb-4e19-bb50-8ae37d4e26ad None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:43.464981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca202184-49cb-4e19-bb50-8ae37d4e26ad None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:43.466512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca202184-49cb-4e19-bb50-8ae37d4e26ad None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:43.468228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 179/361] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:43 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:43.469446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f801-1b91-48db-99cd-3ff481f8a4e5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:43.469722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f801-1b91-48db-99cd-3ff481f8a4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:43.469986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f801-1b91-48db-99cd-3ff481f8a4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:43.491517 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-27d9f801-1b91-48db-99cd-3ff481f8a4e5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:43.492649 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-27d9f801-1b91-48db-99cd-3ff481f8a4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:43.495424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d5548-f196-440a-b275-2e37fd492170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:43.496333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d5548-f196-440a-b275-2e37fd492170 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:43.496615 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d5548-f196-440a-b275-2e37fd492170 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:43.496946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d5548-f196-440a-b275-2e37fd492170 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:43.497633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d5548-f196-440a-b275-2e37fd492170 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:43.497932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d5548-f196-440a-b275-2e37fd492170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:43.499380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d5548-f196-440a-b275-2e37fd492170 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:43.509817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 183/362] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:43.510799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d5548-f196-440a-b275-2e37fd492170 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:43.594102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 180/363] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:43.596427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f801-1b91-48db-99cd-3ff481f8a4e5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:43.657668 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:43.675239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d5548-f196-440a-b275-2e37fd492170 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:43.731685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b57ad-adea-4b5a-ae67-a87294ebf9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:43.732331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b57ad-adea-4b5a-ae67-a87294ebf9eb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:43.732598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b57ad-adea-4b5a-ae67-a87294ebf9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:43.732857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b57ad-adea-4b5a-ae67-a87294ebf9eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:43.747427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b57ad-adea-4b5a-ae67-a87294ebf9eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-085b57ad-adea-4b5a-ae67-a87294ebf9eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:43.753185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:43.754940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 184/364] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:43.755953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b57ad-adea-4b5a-ae67-a87294ebf9eb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:43.762826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f801-1b91-48db-99cd-3ff481f8a4e5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:43.790586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:43.833776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc38cc-7b90-477a-86e2-13699ee6ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:43.835052 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc38cc-7b90-477a-86e2-13699ee6ae52 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:43.835524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc38cc-7b90-477a-86e2-13699ee6ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:43.836262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc38cc-7b90-477a-86e2-13699ee6ae52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:43.837649 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc38cc-7b90-477a-86e2-13699ee6ae52 None admin] RBAC: Adding query filter params (group.id=c2af1b3f513f47208dc1d8e0b9f72799, role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=5155bcda0dce418e98bae20b53135115) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:43.838200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc38cc-7b90-477a-86e2-13699ee6ae52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:43.840483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc38cc-7b90-477a-86e2-13699ee6ae52 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:43.852754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 181/365] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:43 2022] GET /identity/v3/role_assignments?group.id=c2af1b3f513f47208dc1d8e0b9f72799&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=2e42b82a17a84744960aa3904ab682cc => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:43.854988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc38cc-7b90-477a-86e2-13699ee6ae52 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:43.959548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b57ad-adea-4b5a-ae67-a87294ebf9eb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:44.010277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b89c1-2622-45eb-8c3a-fd9a301a8fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:44.011035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b89c1-2622-45eb-8c3a-fd9a301a8fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:44.011366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b89c1-2622-45eb-8c3a-fd9a301a8fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:44.011633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b89c1-2622-45eb-8c3a-fd9a301a8fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:44.033310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc38cc-7b90-477a-86e2-13699ee6ae52 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:44.034887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:44.081854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91170666-0cf7-4163-b0d9-2e4adf040aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:44.082920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91170666-0cf7-4163-b0d9-2e4adf040aeb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:44.083403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91170666-0cf7-4163-b0d9-2e4adf040aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:44.083873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91170666-0cf7-4163-b0d9-2e4adf040aeb None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:44.084736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91170666-0cf7-4163-b0d9-2e4adf040aeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:44.085189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91170666-0cf7-4163-b0d9-2e4adf040aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:44.086789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91170666-0cf7-4163-b0d9-2e4adf040aeb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:44.096506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 182/366] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:44.097721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91170666-0cf7-4163-b0d9-2e4adf040aeb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:44.104673 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b89c1-2622-45eb-8c3a-fd9a301a8fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:44.106176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b89c1-2622-45eb-8c3a-fd9a301a8fb0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:44.148371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:44.212700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91170666-0cf7-4163-b0d9-2e4adf040aeb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:44.239228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 185/367] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:44.241147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b89c1-2622-45eb-8c3a-fd9a301a8fb0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:44.256327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638913da-09b9-42d9-8eb9-ec22bdd9b363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:44.256924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638913da-09b9-42d9-8eb9-ec22bdd9b363 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:44.257203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638913da-09b9-42d9-8eb9-ec22bdd9b363 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:44.257475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638913da-09b9-42d9-8eb9-ec22bdd9b363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:44.270032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638913da-09b9-42d9-8eb9-ec22bdd9b363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-638913da-09b9-42d9-8eb9-ec22bdd9b363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:44.275440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:44.276438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 183/368] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:18:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:44.280827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638913da-09b9-42d9-8eb9-ec22bdd9b363 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:44.326551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:44.408221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b89c1-2622-45eb-8c3a-fd9a301a8fb0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:44.457821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d86f05-7fbe-45ee-ab11-10dab2723d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:44.458742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86f05-7fbe-45ee-ab11-10dab2723d5f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:44.459263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86f05-7fbe-45ee-ab11-10dab2723d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:44.459677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86f05-7fbe-45ee-ab11-10dab2723d5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:44.465625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638913da-09b9-42d9-8eb9-ec22bdd9b363 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:44.467519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:44.515597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a08ecd-3715-4852-91b6-36c880b8ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:44.516241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a08ecd-3715-4852-91b6-36c880b8ba70 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:44.516680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a08ecd-3715-4852-91b6-36c880b8ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:44.517094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a08ecd-3715-4852-91b6-36c880b8ba70 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:44.518930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a08ecd-3715-4852-91b6-36c880b8ba70 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:44.520721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a08ecd-3715-4852-91b6-36c880b8ba70 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:44.522883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 184/369] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:44 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:44.523789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a08ecd-3715-4852-91b6-36c880b8ba70 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:44.552979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d86f05-7fbe-45ee-ab11-10dab2723d5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:44.555873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d86f05-7fbe-45ee-ab11-10dab2723d5f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:44.627095 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:44.657922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a08ecd-3715-4852-91b6-36c880b8ba70 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:44.694791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 186/370] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:44.696251 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d86f05-7fbe-45ee-ab11-10dab2723d5f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:44.722251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf1007-f63c-4e7e-badb-24a5677fc3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:44.723461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf1007-f63c-4e7e-badb-24a5677fc3fb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:44.723824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf1007-f63c-4e7e-badb-24a5677fc3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:44.724114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf1007-f63c-4e7e-badb-24a5677fc3fb None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:44.725123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf1007-f63c-4e7e-badb-24a5677fc3fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:44.725620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf1007-f63c-4e7e-badb-24a5677fc3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:44.727143 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf1007-f63c-4e7e-badb-24a5677fc3fb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:44.738891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 185/371] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:44.740041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf1007-f63c-4e7e-badb-24a5677fc3fb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:44.790806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:44.880272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d86f05-7fbe-45ee-ab11-10dab2723d5f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:44.905984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf1007-f63c-4e7e-badb-24a5677fc3fb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:44.939005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f131ea-4d41-469b-b669-e84c3a08d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:44.940010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f131ea-4d41-469b-b669-e84c3a08d421 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:44.940514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f131ea-4d41-469b-b669-e84c3a08d421 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:44.940979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f131ea-4d41-469b-b669-e84c3a08d421 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:44.942778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f131ea-4d41-469b-b669-e84c3a08d421 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:44.944735 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f131ea-4d41-469b-b669-e84c3a08d421 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:44.948224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 187/372] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:44 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:44.949286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f131ea-4d41-469b-b669-e84c3a08d421 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:44.957090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a66a-bb21-4269-bd11-65ebea4b18ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:44.958020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a66a-bb21-4269-bd11-65ebea4b18ca None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:44.959199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a66a-bb21-4269-bd11-65ebea4b18ca None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:44.959598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a66a-bb21-4269-bd11-65ebea4b18ca None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:44.963432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a66a-bb21-4269-bd11-65ebea4b18ca None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:44.964930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a66a-bb21-4269-bd11-65ebea4b18ca None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:44.966829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 186/373] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:44 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:44.969024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a66a-bb21-4269-bd11-65ebea4b18ca None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:44.985775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:45.085010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:45.088374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a66a-bb21-4269-bd11-65ebea4b18ca None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:45.089481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f131ea-4d41-469b-b669-e84c3a08d421 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:45.126279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68b6cb-0661-4b95-985e-682d02bb1780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:45.127282 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68b6cb-0661-4b95-985e-682d02bb1780 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:45.127833 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68b6cb-0661-4b95-985e-682d02bb1780 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:45.128358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68b6cb-0661-4b95-985e-682d02bb1780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:45.129495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68b6cb-0661-4b95-985e-682d02bb1780 None admin] RBAC: Adding query filter params (group.id=c2af1b3f513f47208dc1d8e0b9f72799, role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=92436548309e4b6f9ccf5357c5fb8342) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:45.130052 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68b6cb-0661-4b95-985e-682d02bb1780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:45.131025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3301e-015d-4947-b959-7b5bc0fae408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:45.131899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3301e-015d-4947-b959-7b5bc0fae408 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:45.132120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68b6cb-0661-4b95-985e-682d02bb1780 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:45.132463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3301e-015d-4947-b959-7b5bc0fae408 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:45.132878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3301e-015d-4947-b959-7b5bc0fae408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:45.138913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 187/374] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:44 2022] GET /identity/v3/role_assignments?group.id=c2af1b3f513f47208dc1d8e0b9f72799&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:45.140119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68b6cb-0661-4b95-985e-682d02bb1780 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:45.252948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3301e-015d-4947-b959-7b5bc0fae408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:45.254435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3301e-015d-4947-b959-7b5bc0fae408 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:45.256066 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68b6cb-0661-4b95-985e-682d02bb1780 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:45.287461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:45.295854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599a05f-d7f6-48bf-aa97-d414c3eaabd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:45.296854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599a05f-d7f6-48bf-aa97-d414c3eaabd6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:45.297329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599a05f-d7f6-48bf-aa97-d414c3eaabd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:45.297829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599a05f-d7f6-48bf-aa97-d414c3eaabd6 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:45.299234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599a05f-d7f6-48bf-aa97-d414c3eaabd6 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:45.300901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599a05f-d7f6-48bf-aa97-d414c3eaabd6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:45.302970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 188/375] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:45 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:45.311983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599a05f-d7f6-48bf-aa97-d414c3eaabd6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:45.358356 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:45.410069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 188/376] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:45.413679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3301e-015d-4947-b959-7b5bc0fae408 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:45.463417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599a05f-d7f6-48bf-aa97-d414c3eaabd6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:45.513255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278a384-79aa-4264-b855-eff2e3baef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:45.514529 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a384-79aa-4264-b855-eff2e3baef16 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:45.515048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a384-79aa-4264-b855-eff2e3baef16 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:45.515679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a384-79aa-4264-b855-eff2e3baef16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:45.517330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278a384-79aa-4264-b855-eff2e3baef16 None admin] RBAC: Adding query filter params (group.id=c2af1b3f513f47208dc1d8e0b9f72799, role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=92436548309e4b6f9ccf5357c5fb8342) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:45.517897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278a384-79aa-4264-b855-eff2e3baef16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:45.520249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278a384-79aa-4264-b855-eff2e3baef16 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:45.529296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 189/377] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:45 2022] GET /identity/v3/role_assignments?group.id=c2af1b3f513f47208dc1d8e0b9f72799&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=2e42b82a17a84744960aa3904ab682cc => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:45.540441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3301e-015d-4947-b959-7b5bc0fae408 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:45.576141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:45.585451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb9d80-550a-4f61-9228-7dfb606c6bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:45.586105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb9d80-550a-4f61-9228-7dfb606c6bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:45.586377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb9d80-550a-4f61-9228-7dfb606c6bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:45.586641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb9d80-550a-4f61-9228-7dfb606c6bc6 None admin] PATH_INFO: `/v3/projects/7911c9363a5f49a3b74eb85a8f08a450` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:45.587914 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb9d80-550a-4f61-9228-7dfb606c6bc6 None admin] RBAC: Authorizing `identity:get_project(project_id=7911c9363a5f49a3b74eb85a8f08a450)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:45.589376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb9d80-550a-4f61-9228-7dfb606c6bc6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:45.593220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 189/378] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:45 2022] GET /identity/v3/projects/7911c9363a5f49a3b74eb85a8f08a450 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:45.599371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278a384-79aa-4264-b855-eff2e3baef16 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:45.728874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:45.738135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278a384-79aa-4264-b855-eff2e3baef16 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:45.743822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083071a9-09e8-4443-a0db-69649e12977d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:45.744233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083071a9-09e8-4443-a0db-69649e12977d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:45.744639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083071a9-09e8-4443-a0db-69649e12977d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:45.746754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 190/379] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:45.752465 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c6a19-81f0-4093-8f1d-e73a8d2fad2e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:45.752748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c6a19-81f0-4093-8f1d-e73a8d2fad2e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:45.753021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c6a19-81f0-4093-8f1d-e73a8d2fad2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:45.775509 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-249c6a19-81f0-4093-8f1d-e73a8d2fad2e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:45.777093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-249c6a19-81f0-4093-8f1d-e73a8d2fad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:45.807159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f28a-88d5-4662-a035-9b422052caae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:45.808594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f28a-88d5-4662-a035-9b422052caae None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:45.809144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f28a-88d5-4662-a035-9b422052caae None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:45.809774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f28a-88d5-4662-a035-9b422052caae None admin] PATH_INFO: `/v3/groups/e8eff8acfeda4f21bb0d8d01b354219e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:45.822633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87f28a-88d5-4662-a035-9b422052caae None admin] RBAC: Authorizing `identity:get_group(group_id=e8eff8acfeda4f21bb0d8d01b354219e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:45.826060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87f28a-88d5-4662-a035-9b422052caae None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:45.830130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 190/380] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:45 2022] GET /identity/v3/groups/e8eff8acfeda4f21bb0d8d01b354219e => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:45.836269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f28a-88d5-4662-a035-9b422052caae None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:45.883544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 191/381] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:45.962678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f28a-88d5-4662-a035-9b422052caae None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:46.005061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c396cf7-6a6e-4ea9-a4aa-aba3d658568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:46.005937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396cf7-6a6e-4ea9-a4aa-aba3d658568e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:46.006347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396cf7-6a6e-4ea9-a4aa-aba3d658568e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:46.006772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396cf7-6a6e-4ea9-a4aa-aba3d658568e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:46.007635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c396cf7-6a6e-4ea9-a4aa-aba3d658568e None admin] RBAC: Adding query filter params (group.id=e8eff8acfeda4f21bb0d8d01b354219e, role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=7911c9363a5f49a3b74eb85a8f08a450) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:46.008102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c396cf7-6a6e-4ea9-a4aa-aba3d658568e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:46.009690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c396cf7-6a6e-4ea9-a4aa-aba3d658568e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:46.019444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 191/382] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:45 2022] GET /identity/v3/role_assignments?group.id=e8eff8acfeda4f21bb0d8d01b354219e&scope.project.id=7911c9363a5f49a3b74eb85a8f08a450&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:46.194320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c6a19-81f0-4093-8f1d-e73a8d2fad2e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:46.319720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795282-300d-4338-9a4f-b5cd00f37d81 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:46.320375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795282-300d-4338-9a4f-b5cd00f37d81 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:46.320958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795282-300d-4338-9a4f-b5cd00f37d81 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:46.326195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c6a19-81f0-4093-8f1d-e73a8d2fad2e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:46.326806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 192/383] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:46.329281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2421a2-eb14-4e27-8f93-d65269292ac5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:46.329563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2421a2-eb14-4e27-8f93-d65269292ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:46.329832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2421a2-eb14-4e27-8f93-d65269292ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:46.355034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:46.370296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3a2421a2-eb14-4e27-8f93-d65269292ac5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:46.371816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3a2421a2-eb14-4e27-8f93-d65269292ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:46.400616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:46.410837 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fb5e8-24fb-4e2f-a161-cb9db28c0a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:46.412457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fb5e8-24fb-4e2f-a161-cb9db28c0a4b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:46.412802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fb5e8-24fb-4e2f-a161-cb9db28c0a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:46.413159 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fb5e8-24fb-4e2f-a161-cb9db28c0a4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:46.435602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fb5e8-24fb-4e2f-a161-cb9db28c0a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-649fb5e8-24fb-4e2f-a161-cb9db28c0a4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:46.440623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:46.441504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:46.442906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 192/384] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:46.449253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fb5e8-24fb-4e2f-a161-cb9db28c0a4b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:46.464010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 193/385] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:46.559559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fb5e8-24fb-4e2f-a161-cb9db28c0a4b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:46.596507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953155b-1391-4965-89f3-e23cbd5feefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:46.597860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953155b-1391-4965-89f3-e23cbd5feefe None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:46.598384 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953155b-1391-4965-89f3-e23cbd5feefe None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:46.598859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953155b-1391-4965-89f3-e23cbd5feefe None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:46.599784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953155b-1391-4965-89f3-e23cbd5feefe None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:46.600266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953155b-1391-4965-89f3-e23cbd5feefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:46.601841 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953155b-1391-4965-89f3-e23cbd5feefe None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:46.611301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 193/386] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:46.619997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2421a2-eb14-4e27-8f93-d65269292ac5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:46.730533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2421a2-eb14-4e27-8f93-d65269292ac5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:46.767087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f3363-6aa6-4558-b3a2-e1bbf49eb9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:46.768105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f3363-6aa6-4558-b3a2-e1bbf49eb9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:46.768783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f3363-6aa6-4558-b3a2-e1bbf49eb9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:46.769470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f3363-6aa6-4558-b3a2-e1bbf49eb9a8 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:46.771503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f3363-6aa6-4558-b3a2-e1bbf49eb9a8 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:46.773497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f3363-6aa6-4558-b3a2-e1bbf49eb9a8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:46.775841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 194/387] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:46 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:46.783868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953155b-1391-4965-89f3-e23cbd5feefe None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:46.799402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f3363-6aa6-4558-b3a2-e1bbf49eb9a8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:46.833481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:46.895447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:46.928197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f3363-6aa6-4558-b3a2-e1bbf49eb9a8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:46.969335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ae2be-d4b7-4bde-90f8-4e9874d5f1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:46.970359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae2be-d4b7-4bde-90f8-4e9874d5f1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:46.970926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae2be-d4b7-4bde-90f8-4e9874d5f1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:46.971211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae2be-d4b7-4bde-90f8-4e9874d5f1d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:46.984550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ae2be-d4b7-4bde-90f8-4e9874d5f1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-155ae2be-d4b7-4bde-90f8-4e9874d5f1d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:46.989557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:46.990775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:46.991544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 195/388] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:18:47.003737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ae2be-d4b7-4bde-90f8-4e9874d5f1d2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:47.087366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953155b-1391-4965-89f3-e23cbd5feefe None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:47.155612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:47.162978 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525882c-e4ba-459b-b810-a4489d20d260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:47.164778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525882c-e4ba-459b-b810-a4489d20d260 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:47.165254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525882c-e4ba-459b-b810-a4489d20d260 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:47.165712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525882c-e4ba-459b-b810-a4489d20d260 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:47.167074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525882c-e4ba-459b-b810-a4489d20d260 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:47.168712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525882c-e4ba-459b-b810-a4489d20d260 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:47.170988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 194/389] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:46 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:47.178693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525882c-e4ba-459b-b810-a4489d20d260 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:47.201939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ae2be-d4b7-4bde-90f8-4e9874d5f1d2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:47.279699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66194c3a-8047-4620-a227-7ad84bd977f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:47.280289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66194c3a-8047-4620-a227-7ad84bd977f9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:47.280569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66194c3a-8047-4620-a227-7ad84bd977f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:47.280842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66194c3a-8047-4620-a227-7ad84bd977f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:47.281524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66194c3a-8047-4620-a227-7ad84bd977f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:47.281827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66194c3a-8047-4620-a227-7ad84bd977f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:47.283346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66194c3a-8047-4620-a227-7ad84bd977f9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:47.302971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 196/390] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:47.311017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66194c3a-8047-4620-a227-7ad84bd977f9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:47.352806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525882c-e4ba-459b-b810-a4489d20d260 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:47.361718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:47.398855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ef39e-d85d-437e-97e2-7e2ac11e64c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:47.400315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ef39e-d85d-437e-97e2-7e2ac11e64c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:47.400776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ef39e-d85d-437e-97e2-7e2ac11e64c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:47.401321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ef39e-d85d-437e-97e2-7e2ac11e64c9 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115/groups/c2af1b3f513f47208dc1d8e0b9f72799/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:47.403803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ef39e-d85d-437e-97e2-7e2ac11e64c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5155bcda0dce418e98bae20b53135115, group_id=c2af1b3f513f47208dc1d8e0b9f72799, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:47.405782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ef39e-d85d-437e-97e2-7e2ac11e64c9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:47.426164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 195/391] 10.222.0.78 () {58 vars in 1442 bytes} [Wed Aug 24 03:18:47 2022] PUT /identity/v3/projects/5155bcda0dce418e98bae20b53135115/groups/c2af1b3f513f47208dc1d8e0b9f72799/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:47.478134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66194c3a-8047-4620-a227-7ad84bd977f9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:47.522483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580ce1-f291-4264-bed4-5954788023e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:47.523194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580ce1-f291-4264-bed4-5954788023e1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:47.523474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580ce1-f291-4264-bed4-5954788023e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:47.523823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580ce1-f291-4264-bed4-5954788023e1 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:47.525063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580ce1-f291-4264-bed4-5954788023e1 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:47.526714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580ce1-f291-4264-bed4-5954788023e1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:47.528659 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 197/392] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:47 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:47.534863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ef39e-d85d-437e-97e2-7e2ac11e64c9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:47.692253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ef39e-d85d-437e-97e2-7e2ac11e64c9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:47.745747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51401a-72ea-4ecc-8190-28f6bb90ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:47.746793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51401a-72ea-4ecc-8190-28f6bb90ec01 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:47.747271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51401a-72ea-4ecc-8190-28f6bb90ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:47.747774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51401a-72ea-4ecc-8190-28f6bb90ec01 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:47.751364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51401a-72ea-4ecc-8190-28f6bb90ec01 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:47.752819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51401a-72ea-4ecc-8190-28f6bb90ec01 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:47.754751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 196/393] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:47 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:47.760627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580ce1-f291-4264-bed4-5954788023e1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:47.790227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:47.906113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580ce1-f291-4264-bed4-5954788023e1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:47.950841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c337100-e9c1-4e97-9004-d0dcd283269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:47.951521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c337100-e9c1-4e97-9004-d0dcd283269b None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:47.951799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c337100-e9c1-4e97-9004-d0dcd283269b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:47.952072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c337100-e9c1-4e97-9004-d0dcd283269b None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115/groups/c2af1b3f513f47208dc1d8e0b9f72799/roles/2e42b82a17a84744960aa3904ab682cc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:47.956610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c337100-e9c1-4e97-9004-d0dcd283269b None admin] RBAC: Authorizing `identity:create_grant(project_id=5155bcda0dce418e98bae20b53135115, group_id=c2af1b3f513f47208dc1d8e0b9f72799, role_id=2e42b82a17a84744960aa3904ab682cc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:47.958141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c337100-e9c1-4e97-9004-d0dcd283269b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:47.980100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 198/394] 10.222.0.78 () {58 vars in 1442 bytes} [Wed Aug 24 03:18:47 2022] PUT /identity/v3/projects/5155bcda0dce418e98bae20b53135115/groups/c2af1b3f513f47208dc1d8e0b9f72799/roles/2e42b82a17a84744960aa3904ab682cc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:48.103628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd50e0-cdc1-4da9-a165-32d0d867cf90 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:48.104319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd50e0-cdc1-4da9-a165-32d0d867cf90 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:48.104799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd50e0-cdc1-4da9-a165-32d0d867cf90 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:48.106441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 197/395] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:48.113442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fcbb4-4cc2-4b41-b474-a33d2d23cd28 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:48.114174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fcbb4-4cc2-4b41-b474-a33d2d23cd28 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:48.115377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fcbb4-4cc2-4b41-b474-a33d2d23cd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:48.142933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fa2fcbb4-4cc2-4b41-b474-a33d2d23cd28 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:48.144567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fa2fcbb4-4cc2-4b41-b474-a33d2d23cd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:48.219820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f5fb8-7dae-4d79-abb1-bf7317ce8e6c None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:48.220586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f5fb8-7dae-4d79-abb1-bf7317ce8e6c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:48.221053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f5fb8-7dae-4d79-abb1-bf7317ce8e6c None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:48.222912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 198/396] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:48.229477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbd6a5-5838-4ff2-b959-8b5836698cc3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:48.230072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbd6a5-5838-4ff2-b959-8b5836698cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:48.230607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbd6a5-5838-4ff2-b959-8b5836698cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:48.235941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 199/397] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:48.254738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-36dbd6a5-5838-4ff2-b959-8b5836698cc3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:48.256334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-36dbd6a5-5838-4ff2-b959-8b5836698cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:48.291321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:48.347880 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 199/398] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:48.533690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fcbb4-4cc2-4b41-b474-a33d2d23cd28 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:48.536266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:48.679345 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fcbb4-4cc2-4b41-b474-a33d2d23cd28 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:48.736452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9b9b8-f601-46cb-9311-123ba8ed6411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:48.737115 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9b9b8-f601-46cb-9311-123ba8ed6411 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:48.737394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9b9b8-f601-46cb-9311-123ba8ed6411 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:48.737662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9b9b8-f601-46cb-9311-123ba8ed6411 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:48.749764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9b9b8-f601-46cb-9311-123ba8ed6411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-34e9b9b8-f601-46cb-9311-123ba8ed6411 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:48.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:48.755433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:48.756696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 200/399] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:48.763502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbd6a5-5838-4ff2-b959-8b5836698cc3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:48.779849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f41baf-7684-49c1-a20e-410d182d05bf None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:48.780365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f41baf-7684-49c1-a20e-410d182d05bf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:48.780440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f41baf-7684-49c1-a20e-410d182d05bf None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:48.781907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 201/400] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:18:48.792262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303bc02-749e-4079-b94d-0393f5a032ae None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:48.792528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303bc02-749e-4079-b94d-0393f5a032ae None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:48.792727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303bc02-749e-4079-b94d-0393f5a032ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:48.820380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8303bc02-749e-4079-b94d-0393f5a032ae None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:48.821644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8303bc02-749e-4079-b94d-0393f5a032ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:48.911203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:48.921056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 202/401] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:48.921393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbd6a5-5838-4ff2-b959-8b5836698cc3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:48.927994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303bc02-749e-4079-b94d-0393f5a032ae None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:48.963373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba552-9d2e-4dd1-8003-79045bac0525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:48.964272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba552-9d2e-4dd1-8003-79045bac0525 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:48.964711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba552-9d2e-4dd1-8003-79045bac0525 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:48.965119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba552-9d2e-4dd1-8003-79045bac0525 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:48.965952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bba552-9d2e-4dd1-8003-79045bac0525 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:48.966415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bba552-9d2e-4dd1-8003-79045bac0525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:48.968005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bba552-9d2e-4dd1-8003-79045bac0525 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:48.978076 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 200/402] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:48.985246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba552-9d2e-4dd1-8003-79045bac0525 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:49.055129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:49.167147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303bc02-749e-4079-b94d-0393f5a032ae None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:49.213210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba552-9d2e-4dd1-8003-79045bac0525 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:49.241384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c407794-4683-48c3-924e-7861533cf1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:49.243400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c407794-4683-48c3-924e-7861533cf1df None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:49.244762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c407794-4683-48c3-924e-7861533cf1df None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:49.245394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c407794-4683-48c3-924e-7861533cf1df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:49.263253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c407794-4683-48c3-924e-7861533cf1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7c407794-4683-48c3-924e-7861533cf1df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:49.269189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:49.271364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:49.272589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 203/403] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:49.279469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c407794-4683-48c3-924e-7861533cf1df None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:49.285816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce933b44-cb59-4b16-ba28-0e990dc3c0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:49.286143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933b44-cb59-4b16-ba28-0e990dc3c0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:49.286424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933b44-cb59-4b16-ba28-0e990dc3c0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:49.286780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933b44-cb59-4b16-ba28-0e990dc3c0e4 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:49.287945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce933b44-cb59-4b16-ba28-0e990dc3c0e4 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:49.289417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce933b44-cb59-4b16-ba28-0e990dc3c0e4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:49.291095 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 201/404] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:48 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:49.291881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce933b44-cb59-4b16-ba28-0e990dc3c0e4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:49.350225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:49.402646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c407794-4683-48c3-924e-7861533cf1df None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:49.403107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:49.409767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce933b44-cb59-4b16-ba28-0e990dc3c0e4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:49.441562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76afa-1e4c-4b53-90e8-758deabda463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:49.442737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76afa-1e4c-4b53-90e8-758deabda463 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:49.443227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76afa-1e4c-4b53-90e8-758deabda463 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:49.443701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76afa-1e4c-4b53-90e8-758deabda463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:49.450744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d129cc-7959-4b4d-bb2d-6b474691617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:49.451539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d129cc-7959-4b4d-bb2d-6b474691617e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:49.451818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d129cc-7959-4b4d-bb2d-6b474691617e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:49.452085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d129cc-7959-4b4d-bb2d-6b474691617e None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:49.452758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d129cc-7959-4b4d-bb2d-6b474691617e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:49.453054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d129cc-7959-4b4d-bb2d-6b474691617e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:49.454693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d129cc-7959-4b4d-bb2d-6b474691617e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:49.458145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e76afa-1e4c-4b53-90e8-758deabda463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:49.468050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 202/405] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:49.468050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d129cc-7959-4b4d-bb2d-6b474691617e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-31e76afa-1e4c-4b53-90e8-758deabda463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:49.468730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:49.469622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:49.470422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:49.473454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 204/406] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:49.474815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76afa-1e4c-4b53-90e8-758deabda463 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:49.573389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d129cc-7959-4b4d-bb2d-6b474691617e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:49.581777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76afa-1e4c-4b53-90e8-758deabda463 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:49.595720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:49.616409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096d79d-4aa6-4d62-8aac-d03763c067f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:49.617601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096d79d-4aa6-4d62-8aac-d03763c067f4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:49.618050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096d79d-4aa6-4d62-8aac-d03763c067f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:49.618475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096d79d-4aa6-4d62-8aac-d03763c067f4 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:49.619796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096d79d-4aa6-4d62-8aac-d03763c067f4 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:49.620417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a77f6-ddd2-4ab1-ba50-1a687711d2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:49.621233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096d79d-4aa6-4d62-8aac-d03763c067f4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:49.621487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a77f6-ddd2-4ab1-ba50-1a687711d2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:49.621963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a77f6-ddd2-4ab1-ba50-1a687711d2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:49.622424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a77f6-ddd2-4ab1-ba50-1a687711d2d2 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:49.622927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 203/407] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:49 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:49.623781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096d79d-4aa6-4d62-8aac-d03763c067f4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:49.624363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a77f6-ddd2-4ab1-ba50-1a687711d2d2 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:49.626108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a77f6-ddd2-4ab1-ba50-1a687711d2d2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:49.628379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 205/408] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:49 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:49.629516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a77f6-ddd2-4ab1-ba50-1a687711d2d2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:49.651765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:49.735916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a77f6-ddd2-4ab1-ba50-1a687711d2d2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:49.739393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096d79d-4aa6-4d62-8aac-d03763c067f4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:49.773360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae86029-185d-4a98-88d8-de6212f0b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:49.774417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86029-185d-4a98-88d8-de6212f0b2f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:49.774927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86029-185d-4a98-88d8-de6212f0b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:49.775398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86029-185d-4a98-88d8-de6212f0b2f6 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342/groups/c2af1b3f513f47208dc1d8e0b9f72799/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:49.776445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c29a7-264b-490c-af6b-da9c663ae19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:49.777065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c29a7-264b-490c-af6b-da9c663ae19b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:49.777339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c29a7-264b-490c-af6b-da9c663ae19b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:49.777605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c29a7-264b-490c-af6b-da9c663ae19b None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:49.778486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c29a7-264b-490c-af6b-da9c663ae19b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:49.778832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c29a7-264b-490c-af6b-da9c663ae19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:49.779254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae86029-185d-4a98-88d8-de6212f0b2f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=92436548309e4b6f9ccf5357c5fb8342, group_id=c2af1b3f513f47208dc1d8e0b9f72799, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:49.780212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c29a7-264b-490c-af6b-da9c663ae19b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:49.781112 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae86029-185d-4a98-88d8-de6212f0b2f6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:49.790718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 204/409] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:49.791674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c29a7-264b-490c-af6b-da9c663ae19b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:49.814687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 206/410] 10.222.0.78 () {58 vars in 1442 bytes} [Wed Aug 24 03:18:49 2022] PUT /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342/groups/c2af1b3f513f47208dc1d8e0b9f72799/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:49.814687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae86029-185d-4a98-88d8-de6212f0b2f6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:49.909909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:49.957966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:49.982258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c29a7-264b-490c-af6b-da9c663ae19b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:49.984650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae86029-185d-4a98-88d8-de6212f0b2f6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:50.028283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd930e6-8cd0-4a40-87ec-e41c2c9c1aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:50.029219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd930e6-8cd0-4a40-87ec-e41c2c9c1aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.029621 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd930e6-8cd0-4a40-87ec-e41c2c9c1aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.030000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd930e6-8cd0-4a40-87ec-e41c2c9c1aa8 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.031486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd930e6-8cd0-4a40-87ec-e41c2c9c1aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:50.032489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0116c1-ba15-4d86-9f2f-c6f7d01c4787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:50.032926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd930e6-8cd0-4a40-87ec-e41c2c9c1aa8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:50.033113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0116c1-ba15-4d86-9f2f-c6f7d01c4787 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.033389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0116c1-ba15-4d86-9f2f-c6f7d01c4787 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.033659 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0116c1-ba15-4d86-9f2f-c6f7d01c4787 None admin] PATH_INFO: `/v3/groups/e8eff8acfeda4f21bb0d8d01b354219e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.034805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0116c1-ba15-4d86-9f2f-c6f7d01c4787 None admin] RBAC: Authorizing `identity:get_group(group_id=e8eff8acfeda4f21bb0d8d01b354219e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:50.034973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 205/411] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:49 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:50.036418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0116c1-ba15-4d86-9f2f-c6f7d01c4787 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:50.036536 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2653097-c1e8-40cb-ae67-76e2181b87a0 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.036831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2653097-c1e8-40cb-ae67-76e2181b87a0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.037996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 207/412] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:49 2022] GET /identity/v3/groups/e8eff8acfeda4f21bb0d8d01b354219e => generated 229 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:50.042186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2653097-c1e8-40cb-ae67-76e2181b87a0 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.043311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0116c1-ba15-4d86-9f2f-c6f7d01c4787 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:50.043935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 206/413] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:50.044943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2653097-c1e8-40cb-ae67-76e2181b87a0 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:50.165274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0116c1-ba15-4d86-9f2f-c6f7d01c4787 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:50.171130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2653097-c1e8-40cb-ae67-76e2181b87a0 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:50.175899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:50.203432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ecbf8-ee55-4f49-83de-ab6c18c65e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:50.204272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ecbf8-ee55-4f49-83de-ab6c18c65e2f None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.204642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ecbf8-ee55-4f49-83de-ab6c18c65e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.205034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ecbf8-ee55-4f49-83de-ab6c18c65e2f None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342/groups/c2af1b3f513f47208dc1d8e0b9f72799/roles/2e42b82a17a84744960aa3904ab682cc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.208191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ecbf8-ee55-4f49-83de-ab6c18c65e2f None admin] RBAC: Authorizing `identity:create_grant(project_id=92436548309e4b6f9ccf5357c5fb8342, group_id=c2af1b3f513f47208dc1d8e0b9f72799, role_id=2e42b82a17a84744960aa3904ab682cc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:50.209554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7102b-829e-4ed1-b94e-398162f05348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:50.209956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ecbf8-ee55-4f49-83de-ab6c18c65e2f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:50.210315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7102b-829e-4ed1-b94e-398162f05348 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.210680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7102b-829e-4ed1-b94e-398162f05348 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.211026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7102b-829e-4ed1-b94e-398162f05348 None admin] PATH_INFO: `/v3/projects/7911c9363a5f49a3b74eb85a8f08a450` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.212242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7102b-829e-4ed1-b94e-398162f05348 None admin] RBAC: Authorizing `identity:get_project(project_id=7911c9363a5f49a3b74eb85a8f08a450)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:50.213818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7102b-829e-4ed1-b94e-398162f05348 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:50.215909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 207/414] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:50 2022] GET /identity/v3/projects/7911c9363a5f49a3b74eb85a8f08a450 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:50.222808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae199398-a21e-405d-a574-f5ec7fb65585 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.223124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae199398-a21e-405d-a574-f5ec7fb65585 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.223611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae199398-a21e-405d-a574-f5ec7fb65585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.235500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 208/415] 10.222.0.78 () {58 vars in 1442 bytes} [Wed Aug 24 03:18:50 2022] PUT /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342/groups/c2af1b3f513f47208dc1d8e0b9f72799/roles/2e42b82a17a84744960aa3904ab682cc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:18:50.244322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ae199398-a21e-405d-a574-f5ec7fb65585 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:50.244723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ecbf8-ee55-4f49-83de-ab6c18c65e2f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:50.245848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ae199398-a21e-405d-a574-f5ec7fb65585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:50.266945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:50.358733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 208/416] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:50.360419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c472c-0253-4363-a6eb-5ea17ac3a98f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.360699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c472c-0253-4363-a6eb-5ea17ac3a98f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.360968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c472c-0253-4363-a6eb-5ea17ac3a98f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.362608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 209/417] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:50.369077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887c87e-857b-4543-a9dc-20aac5687076 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.369356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887c87e-857b-4543-a9dc-20aac5687076 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.369631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887c87e-857b-4543-a9dc-20aac5687076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.399671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8887c87e-857b-4543-a9dc-20aac5687076 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:50.402596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8887c87e-857b-4543-a9dc-20aac5687076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:50.419261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ecbf8-ee55-4f49-83de-ab6c18c65e2f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:50.474905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba95e-d501-4143-8a76-46bc15aac528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:50.476203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba95e-d501-4143-8a76-46bc15aac528 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.476661 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba95e-d501-4143-8a76-46bc15aac528 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.477100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba95e-d501-4143-8a76-46bc15aac528 None admin] PATH_INFO: `/v3/projects/7911c9363a5f49a3b74eb85a8f08a450/groups/e8eff8acfeda4f21bb0d8d01b354219e/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.480326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ba95e-d501-4143-8a76-46bc15aac528 None admin] RBAC: Authorizing `identity:create_grant(project_id=7911c9363a5f49a3b74eb85a8f08a450, group_id=e8eff8acfeda4f21bb0d8d01b354219e, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:50.482999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ba95e-d501-4143-8a76-46bc15aac528 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:50.489804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 210/418] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:50.506828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 209/419] 10.222.0.78 () {58 vars in 1442 bytes} [Wed Aug 24 03:18:50 2022] PUT /identity/v3/projects/7911c9363a5f49a3b74eb85a8f08a450/groups/e8eff8acfeda4f21bb0d8d01b354219e/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:18:50.774399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887c87e-857b-4543-a9dc-20aac5687076 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:50.825019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba95e-d501-4143-8a76-46bc15aac528 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:50.863021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:50.878931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:50.925732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887c87e-857b-4543-a9dc-20aac5687076 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:50.965038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba95e-d501-4143-8a76-46bc15aac528 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:50.980100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c344a-79a5-4e95-8a10-d34cd0a2767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:50.980779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c344a-79a5-4e95-8a10-d34cd0a2767f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:50.981093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c344a-79a5-4e95-8a10-d34cd0a2767f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:50.981325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c344a-79a5-4e95-8a10-d34cd0a2767f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:50.994594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c344a-79a5-4e95-8a10-d34cd0a2767f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-587c344a-79a5-4e95-8a10-d34cd0a2767f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:51.000027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:51.000898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:51.001697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 211/420] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:51.007415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c344a-79a5-4e95-8a10-d34cd0a2767f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:51.010493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d086b-3e86-4f33-83ac-b7a2d1c10279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:51.011560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d086b-3e86-4f33-83ac-b7a2d1c10279 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:51.011976 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d086b-3e86-4f33-83ac-b7a2d1c10279 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:51.012378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d086b-3e86-4f33-83ac-b7a2d1c10279 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:51.036842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d086b-3e86-4f33-83ac-b7a2d1c10279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1a0d086b-3e86-4f33-83ac-b7a2d1c10279 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:51.042055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:51.043215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:51.044206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:51.054234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 210/421] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:18:51.063581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d086b-3e86-4f33-83ac-b7a2d1c10279 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:51.182142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:51.198570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d086b-3e86-4f33-83ac-b7a2d1c10279 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:51.249349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182f008-9ef5-4092-a6fd-2af448b81dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:51.249997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182f008-9ef5-4092-a6fd-2af448b81dca None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:51.250270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182f008-9ef5-4092-a6fd-2af448b81dca None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:51.250535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182f008-9ef5-4092-a6fd-2af448b81dca None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:51.251267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182f008-9ef5-4092-a6fd-2af448b81dca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:51.251560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182f008-9ef5-4092-a6fd-2af448b81dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:51.252999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182f008-9ef5-4092-a6fd-2af448b81dca None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:51.270466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c344a-79a5-4e95-8a10-d34cd0a2767f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:51.274374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 211/422] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:51.280583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182f008-9ef5-4092-a6fd-2af448b81dca None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:51.344293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d9622-1084-4f15-a702-cb84966a169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:51.344835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d9622-1084-4f15-a702-cb84966a169a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:51.345148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d9622-1084-4f15-a702-cb84966a169a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:51.345383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d9622-1084-4f15-a702-cb84966a169a None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:51.346077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d9622-1084-4f15-a702-cb84966a169a None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:51.346372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d9622-1084-4f15-a702-cb84966a169a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:51.347803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d9622-1084-4f15-a702-cb84966a169a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:51.368156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 212/423] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:51.375429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d9622-1084-4f15-a702-cb84966a169a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:51.386067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:51.452157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182f008-9ef5-4092-a6fd-2af448b81dca None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:51.538346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15467bdd-65f9-4ac0-b827-7d1ef3e36eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:51.538995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467bdd-65f9-4ac0-b827-7d1ef3e36eed None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:51.539269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467bdd-65f9-4ac0-b827-7d1ef3e36eed None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:51.539538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467bdd-65f9-4ac0-b827-7d1ef3e36eed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:51.582327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:51.637980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d9622-1084-4f15-a702-cb84966a169a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:51.686031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15467bdd-65f9-4ac0-b827-7d1ef3e36eed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:51.687528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15467bdd-65f9-4ac0-b827-7d1ef3e36eed None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:51.713996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6405-2d2d-492f-b100-f5a8ad164f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:51.714618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6405-2d2d-492f-b100-f5a8ad164f0a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:51.714911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6405-2d2d-492f-b100-f5a8ad164f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:51.715178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6405-2d2d-492f-b100-f5a8ad164f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:51.830496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 212/424] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:18:51.831938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15467bdd-65f9-4ac0-b827-7d1ef3e36eed None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:51.854111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e6405-2d2d-492f-b100-f5a8ad164f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:51.855638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e6405-2d2d-492f-b100-f5a8ad164f0a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:51.859896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:51.935106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:51.967573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 213/425] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:51.975722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6405-2d2d-492f-b100-f5a8ad164f0a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:52.001550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15467bdd-65f9-4ac0-b827-7d1ef3e36eed None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:52.071094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0db816-2a05-4cd7-912e-edfb912bb8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:52.072090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0db816-2a05-4cd7-912e-edfb912bb8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.073586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0db816-2a05-4cd7-912e-edfb912bb8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.074067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0db816-2a05-4cd7-912e-edfb912bb8d3 None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.075594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0db816-2a05-4cd7-912e-edfb912bb8d3 None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:52.078759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0db816-2a05-4cd7-912e-edfb912bb8d3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:52.081467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 213/426] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:51 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:52.089858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0db816-2a05-4cd7-912e-edfb912bb8d3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:52.180725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6405-2d2d-492f-b100-f5a8ad164f0a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:52.184647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:52.227291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292aae5-095d-4842-9eb6-5c4f4c00c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:52.227989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292aae5-095d-4842-9eb6-5c4f4c00c45e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.228571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292aae5-095d-4842-9eb6-5c4f4c00c45e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.228849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292aae5-095d-4842-9eb6-5c4f4c00c45e None admin] PATH_INFO: `/v3/projects/5155bcda0dce418e98bae20b53135115` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.230264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292aae5-095d-4842-9eb6-5c4f4c00c45e None admin] RBAC: Authorizing `identity:get_project(project_id=5155bcda0dce418e98bae20b53135115)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:52.231156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0db816-2a05-4cd7-912e-edfb912bb8d3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:52.231737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292aae5-095d-4842-9eb6-5c4f4c00c45e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:52.234821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 214/427] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:51 2022] GET /identity/v3/projects/5155bcda0dce418e98bae20b53135115 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:52.236035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24648b19-5b9d-4d50-baba-21b0d7dee583 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.236310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24648b19-5b9d-4d50-baba-21b0d7dee583 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.236580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24648b19-5b9d-4d50-baba-21b0d7dee583 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.238205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 215/428] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:52.238940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24648b19-5b9d-4d50-baba-21b0d7dee583 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:52.254708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:52.274354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce1e15-7857-4e4b-99d7-7fc8bcc3a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:52.275110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce1e15-7857-4e4b-99d7-7fc8bcc3a763 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.275444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce1e15-7857-4e4b-99d7-7fc8bcc3a763 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.275776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce1e15-7857-4e4b-99d7-7fc8bcc3a763 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.276981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce1e15-7857-4e4b-99d7-7fc8bcc3a763 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:52.278508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce1e15-7857-4e4b-99d7-7fc8bcc3a763 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:52.280224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 214/429] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:52 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:52.281422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ba5f0-8918-4e00-a6ae-be615705c4f4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.281764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ba5f0-8918-4e00-a6ae-be615705c4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.282097 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ba5f0-8918-4e00-a6ae-be615705c4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.308661 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c68ba5f0-8918-4e00-a6ae-be615705c4f4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:52.310179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c68ba5f0-8918-4e00-a6ae-be615705c4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:52.366354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24648b19-5b9d-4d50-baba-21b0d7dee583 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:52.389743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 215/430] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:52.391226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ba5f0-8918-4e00-a6ae-be615705c4f4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:52.422894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1d615-a2f9-46d6-9c0d-b7773c323785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:52.423541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1d615-a2f9-46d6-9c0d-b7773c323785 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.423813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1d615-a2f9-46d6-9c0d-b7773c323785 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.424073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1d615-a2f9-46d6-9c0d-b7773c323785 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.425242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1d615-a2f9-46d6-9c0d-b7773c323785 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:52.427098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1d615-a2f9-46d6-9c0d-b7773c323785 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:52.429190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 216/431] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:52 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:52.434639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1d615-a2f9-46d6-9c0d-b7773c323785 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:52.492416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:52.536434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ba5f0-8918-4e00-a6ae-be615705c4f4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:52.555731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1d615-a2f9-46d6-9c0d-b7773c323785 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:52.559736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:52.584325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e484af9-0dfe-4034-94a5-8f6425cec9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:52.585206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e484af9-0dfe-4034-94a5-8f6425cec9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.585488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e484af9-0dfe-4034-94a5-8f6425cec9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.585759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e484af9-0dfe-4034-94a5-8f6425cec9f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.586502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e484af9-0dfe-4034-94a5-8f6425cec9f0 None admin] RBAC: Adding query filter params (group.id=c2af1b3f513f47208dc1d8e0b9f72799, role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=5155bcda0dce418e98bae20b53135115) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:52.587649 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e484af9-0dfe-4034-94a5-8f6425cec9f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:52.589875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e484af9-0dfe-4034-94a5-8f6425cec9f0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:52.597206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c695f02-ce18-447a-a81d-54292df154ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:52.598126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c695f02-ce18-447a-a81d-54292df154ce None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.598591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c695f02-ce18-447a-a81d-54292df154ce None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.599096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c695f02-ce18-447a-a81d-54292df154ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.599411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 216/432] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:52 2022] GET /identity/v3/role_assignments?group.id=c2af1b3f513f47208dc1d8e0b9f72799&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=2e42b82a17a84744960aa3904ab682cc => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:52.600487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c695f02-ce18-447a-a81d-54292df154ce None admin] RBAC: Adding query filter params (group.id=c2af1b3f513f47208dc1d8e0b9f72799, role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=5155bcda0dce418e98bae20b53135115) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:52.600690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4a8d-8dc7-4c86-a100-8483dac2bfe0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.600972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4a8d-8dc7-4c86-a100-8483dac2bfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.601246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4a8d-8dc7-4c86-a100-8483dac2bfe0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.601628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c695f02-ce18-447a-a81d-54292df154ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:52.606645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 217/433] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:52.608519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c695f02-ce18-447a-a81d-54292df154ce None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:52.616152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a40c-709f-490c-908a-2defb2e7750f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.616463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a40c-709f-490c-908a-2defb2e7750f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.616704 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a40c-709f-490c-908a-2defb2e7750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.620006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 217/434] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:52 2022] GET /identity/v3/role_assignments?group.id=c2af1b3f513f47208dc1d8e0b9f72799&scope.project.id=5155bcda0dce418e98bae20b53135115&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:52.656082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-33f5a40c-709f-490c-908a-2defb2e7750f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:52.657413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-33f5a40c-709f-490c-908a-2defb2e7750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:52.750082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 218/435] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:52.791049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafbd33-4bdf-43ea-bff5-824ad2f63796 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.791570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafbd33-4bdf-43ea-bff5-824ad2f63796 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.791982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafbd33-4bdf-43ea-bff5-824ad2f63796 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.793865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 218/436] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:52.797898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a40c-709f-490c-908a-2defb2e7750f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:52.802347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba92e4-c2ac-4114-9996-bb6411164377 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.803031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba92e4-c2ac-4114-9996-bb6411164377 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.803480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba92e4-c2ac-4114-9996-bb6411164377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.829580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-79ba92e4-c2ac-4114-9996-bb6411164377 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:52.830898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-79ba92e4-c2ac-4114-9996-bb6411164377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:52.914609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 219/437] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:18:52.933487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a40c-709f-490c-908a-2defb2e7750f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:52.948518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:52.975029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec399d-4f83-4bcc-950c-8b8fc8b36087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:52.975672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec399d-4f83-4bcc-950c-8b8fc8b36087 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:52.975939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec399d-4f83-4bcc-950c-8b8fc8b36087 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:52.976199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec399d-4f83-4bcc-950c-8b8fc8b36087 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:52.988260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec399d-4f83-4bcc-950c-8b8fc8b36087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0cec399d-4f83-4bcc-950c-8b8fc8b36087 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:52.993310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:52.994249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:52.995124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 219/438] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:53.000475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba92e4-c2ac-4114-9996-bb6411164377 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:53.041064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:53.048759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec399d-4f83-4bcc-950c-8b8fc8b36087 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:53.138291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba92e4-c2ac-4114-9996-bb6411164377 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:53.178453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0278ed9-2b7e-41cb-afcf-58bd502cd08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:53.179131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0278ed9-2b7e-41cb-afcf-58bd502cd08c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:53.179367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0278ed9-2b7e-41cb-afcf-58bd502cd08c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:53.179629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0278ed9-2b7e-41cb-afcf-58bd502cd08c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:53.180312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0278ed9-2b7e-41cb-afcf-58bd502cd08c None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:53.180606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0278ed9-2b7e-41cb-afcf-58bd502cd08c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:53.182102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0278ed9-2b7e-41cb-afcf-58bd502cd08c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:53.191638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 220/439] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:53.192516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec399d-4f83-4bcc-950c-8b8fc8b36087 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:53.192846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0278ed9-2b7e-41cb-afcf-58bd502cd08c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:53.234928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66053850-1c40-444b-b07d-6447810edd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:53.235567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66053850-1c40-444b-b07d-6447810edd26 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:53.235845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66053850-1c40-444b-b07d-6447810edd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:53.236111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66053850-1c40-444b-b07d-6447810edd26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:53.251703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66053850-1c40-444b-b07d-6447810edd26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-66053850-1c40-444b-b07d-6447810edd26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:53.261018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:53.261971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:18:53.262914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:53.263814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 220/440] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:53.264544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66053850-1c40-444b-b07d-6447810edd26 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:53.310549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:53.334516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:53.343081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0278ed9-2b7e-41cb-afcf-58bd502cd08c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:53.388734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6800-4cfd-4f4a-8f7d-729351df0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:53.389413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6800-4cfd-4f4a-8f7d-729351df0f78 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:53.389666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6800-4cfd-4f4a-8f7d-729351df0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:53.389955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6800-4cfd-4f4a-8f7d-729351df0f78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:53.399977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66053850-1c40-444b-b07d-6447810edd26 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:53.402723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f6800-4cfd-4f4a-8f7d-729351df0f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-9d2f6800-4cfd-4f4a-8f7d-729351df0f78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:18:53.408030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:53.409034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 221/441] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:53.414824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6800-4cfd-4f4a-8f7d-729351df0f78 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:53.436011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096e3ef-caa0-4c1b-8649-4480a858fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:53.436626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096e3ef-caa0-4c1b-8649-4480a858fe45 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:53.436904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096e3ef-caa0-4c1b-8649-4480a858fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:53.437175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096e3ef-caa0-4c1b-8649-4480a858fe45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:53.508623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096e3ef-caa0-4c1b-8649-4480a858fe45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:53.510148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096e3ef-caa0-4c1b-8649-4480a858fe45 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:53.513715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6800-4cfd-4f4a-8f7d-729351df0f78 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:53.545435 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:53.554595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e5c3a-f9d2-426d-a33d-5993ad4efe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:53.555276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e5c3a-f9d2-426d-a33d-5993ad4efe4c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:53.555547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e5c3a-f9d2-426d-a33d-5993ad4efe4c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:53.555816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e5c3a-f9d2-426d-a33d-5993ad4efe4c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:53.556515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e5c3a-f9d2-426d-a33d-5993ad4efe4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:53.556810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e5c3a-f9d2-426d-a33d-5993ad4efe4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:53.558263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e5c3a-f9d2-426d-a33d-5993ad4efe4c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:53.568064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 222/442] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:18:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:53.571089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e5c3a-f9d2-426d-a33d-5993ad4efe4c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:53.594507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:53.642148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 221/443] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:53.643048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096e3ef-caa0-4c1b-8649-4480a858fe45 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:53.691063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e5c3a-f9d2-426d-a33d-5993ad4efe4c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:53.724895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf6051-4d75-4b06-91b6-b838c111952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:53.725738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf6051-4d75-4b06-91b6-b838c111952c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:53.726124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf6051-4d75-4b06-91b6-b838c111952c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:53.726278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf6051-4d75-4b06-91b6-b838c111952c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:53.726972 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf6051-4d75-4b06-91b6-b838c111952c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:53.727268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf6051-4d75-4b06-91b6-b838c111952c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:53.728653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf6051-4d75-4b06-91b6-b838c111952c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:53.737346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 223/444] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:53.738185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf6051-4d75-4b06-91b6-b838c111952c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:53.751576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096e3ef-caa0-4c1b-8649-4480a858fe45 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:53.782510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:53.789511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8f69c-ef9d-4bdb-9dd5-e10b5e267526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:53.790134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8f69c-ef9d-4bdb-9dd5-e10b5e267526 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:53.790413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8f69c-ef9d-4bdb-9dd5-e10b5e267526 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:53.790723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8f69c-ef9d-4bdb-9dd5-e10b5e267526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:53.824802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:53.844338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf6051-4d75-4b06-91b6-b838c111952c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:53.860327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8f69c-ef9d-4bdb-9dd5-e10b5e267526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:53.861796 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8f69c-ef9d-4bdb-9dd5-e10b5e267526 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:53.881489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1a3a-695c-4528-9d2e-893b1f3cf788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:53.882134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1a3a-695c-4528-9d2e-893b1f3cf788 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:53.882407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1a3a-695c-4528-9d2e-893b1f3cf788 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:53.882689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1a3a-695c-4528-9d2e-893b1f3cf788 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:53.883860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d1a3a-695c-4528-9d2e-893b1f3cf788 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:53.885314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d1a3a-695c-4528-9d2e-893b1f3cf788 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:53.887004 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 224/445] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:53 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:53.887774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1a3a-695c-4528-9d2e-893b1f3cf788 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:53.977230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 222/446] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:53.978235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8f69c-ef9d-4bdb-9dd5-e10b5e267526 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:54.008802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1a3a-695c-4528-9d2e-893b1f3cf788 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:54.010378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:54.047555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cc6c4-9ad9-4a90-a9f2-c57003dcff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:54.048064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cc6c4-9ad9-4a90-a9f2-c57003dcff2f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:54.048338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cc6c4-9ad9-4a90-a9f2-c57003dcff2f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:54.048597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cc6c4-9ad9-4a90-a9f2-c57003dcff2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:54.069519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:54.085490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8f69c-ef9d-4bdb-9dd5-e10b5e267526 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:54.123285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874142a8-1c63-4453-a690-040bc4b0cd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:54.123741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874142a8-1c63-4453-a690-040bc4b0cd96 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:54.124021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874142a8-1c63-4453-a690-040bc4b0cd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:54.124288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874142a8-1c63-4453-a690-040bc4b0cd96 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:54.124764 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cc6c4-9ad9-4a90-a9f2-c57003dcff2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:54.125447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874142a8-1c63-4453-a690-040bc4b0cd96 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:54.126342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cc6c4-9ad9-4a90-a9f2-c57003dcff2f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:54.126884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874142a8-1c63-4453-a690-040bc4b0cd96 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:54.128470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 223/447] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:53 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:54.129228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874142a8-1c63-4453-a690-040bc4b0cd96 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:54.229029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:54.231780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 225/448] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:18:54.232647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cc6c4-9ad9-4a90-a9f2-c57003dcff2f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:54.233354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874142a8-1c63-4453-a690-040bc4b0cd96 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:54.273194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466d21-1f09-488c-836d-4c50526039e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:54.273829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466d21-1f09-488c-836d-4c50526039e0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:54.274101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466d21-1f09-488c-836d-4c50526039e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:54.274366 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466d21-1f09-488c-836d-4c50526039e0 None admin] PATH_INFO: `/v3/projects/92436548309e4b6f9ccf5357c5fb8342` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:54.275586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6466d21-1f09-488c-836d-4c50526039e0 None admin] RBAC: Authorizing `identity:get_project(project_id=92436548309e4b6f9ccf5357c5fb8342)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:54.277041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6466d21-1f09-488c-836d-4c50526039e0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:54.278729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 224/449] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:54 2022] GET /identity/v3/projects/92436548309e4b6f9ccf5357c5fb8342 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:54.279527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466d21-1f09-488c-836d-4c50526039e0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:54.286630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:54.340592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cc6c4-9ad9-4a90-a9f2-c57003dcff2f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:54.375320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4d7b2-509f-4c1f-af65-a8d36a6dcb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:54.375935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4d7b2-509f-4c1f-af65-a8d36a6dcb75 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:54.376217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4d7b2-509f-4c1f-af65-a8d36a6dcb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:54.376485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4d7b2-509f-4c1f-af65-a8d36a6dcb75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:54.377385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4d7b2-509f-4c1f-af65-a8d36a6dcb75 None admin] RBAC: Adding query filter params (group.id=c2af1b3f513f47208dc1d8e0b9f72799, role.id=23a0d2d1a0af4ab48d71d9bbf06057db, scope.project.id=92436548309e4b6f9ccf5357c5fb8342) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:54.377766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4d7b2-509f-4c1f-af65-a8d36a6dcb75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:54.379619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4d7b2-509f-4c1f-af65-a8d36a6dcb75 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:54.386600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 226/450] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:54 2022] GET /identity/v3/role_assignments?group.id=c2af1b3f513f47208dc1d8e0b9f72799&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=23a0d2d1a0af4ab48d71d9bbf06057db => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:54.386600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4d7b2-509f-4c1f-af65-a8d36a6dcb75 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:54.398155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466d21-1f09-488c-836d-4c50526039e0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:54.434800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7008-21af-4a70-8fe8-4f5ff02d9757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:54.435469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7008-21af-4a70-8fe8-4f5ff02d9757 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:54.435751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7008-21af-4a70-8fe8-4f5ff02d9757 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:54.436020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7008-21af-4a70-8fe8-4f5ff02d9757 None admin] PATH_INFO: `/v3/projects/7911c9363a5f49a3b74eb85a8f08a450` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:54.437384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7008-21af-4a70-8fe8-4f5ff02d9757 None admin] RBAC: Authorizing `identity:get_project(project_id=7911c9363a5f49a3b74eb85a8f08a450)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:54.438972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7008-21af-4a70-8fe8-4f5ff02d9757 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:54.441127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 225/451] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:18:54 2022] GET /identity/v3/projects/7911c9363a5f49a3b74eb85a8f08a450 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:54.448410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7008-21af-4a70-8fe8-4f5ff02d9757 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:54.487448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:54.530220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4d7b2-509f-4c1f-af65-a8d36a6dcb75 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:54.548158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:54.579070 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7750-5a54-4376-9f98-89066783a450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:54.579722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7750-5a54-4376-9f98-89066783a450 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:54.579997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7750-5a54-4376-9f98-89066783a450 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:54.580268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7750-5a54-4376-9f98-89066783a450 None admin] PATH_INFO: `/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:54.581902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d7750-5a54-4376-9f98-89066783a450 None admin] RBAC: Authorizing `identity:get_group(group_id=c2af1b3f513f47208dc1d8e0b9f72799)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:54.585118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d7750-5a54-4376-9f98-89066783a450 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:54.585339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7008-21af-4a70-8fe8-4f5ff02d9757 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:54.588325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 227/452] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:54 2022] GET /identity/v3/groups/c2af1b3f513f47208dc1d8e0b9f72799 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:54.595473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7750-5a54-4376-9f98-89066783a450 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:54.636317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaae1eb-0bd6-411a-8982-53fc41757506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:54.637965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaae1eb-0bd6-411a-8982-53fc41757506 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:54.637965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaae1eb-0bd6-411a-8982-53fc41757506 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:54.637965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaae1eb-0bd6-411a-8982-53fc41757506 None admin] PATH_INFO: `/v3/groups/e8eff8acfeda4f21bb0d8d01b354219e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:54.639094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaae1eb-0bd6-411a-8982-53fc41757506 None admin] RBAC: Authorizing `identity:get_group(group_id=e8eff8acfeda4f21bb0d8d01b354219e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:54.640579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaae1eb-0bd6-411a-8982-53fc41757506 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:54.642267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 226/453] 10.222.0.78 () {56 vars in 1180 bytes} [Wed Aug 24 03:18:54 2022] GET /identity/v3/groups/e8eff8acfeda4f21bb0d8d01b354219e => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:54.649501 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaae1eb-0bd6-411a-8982-53fc41757506 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:54.731139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7750-5a54-4376-9f98-89066783a450 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:54.769676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733a649-8f51-4a09-9867-517e19da4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:54.770033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaae1eb-0bd6-411a-8982-53fc41757506 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:54.770870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733a649-8f51-4a09-9867-517e19da4c81 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:54.771373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733a649-8f51-4a09-9867-517e19da4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:54.771978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:54.772105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733a649-8f51-4a09-9867-517e19da4c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:54.773803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733a649-8f51-4a09-9867-517e19da4c81 None admin] RBAC: Adding query filter params (group.id=c2af1b3f513f47208dc1d8e0b9f72799, role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=92436548309e4b6f9ccf5357c5fb8342) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:54.773803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733a649-8f51-4a09-9867-517e19da4c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:54.774582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733a649-8f51-4a09-9867-517e19da4c81 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:54.782405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 228/454] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:54 2022] GET /identity/v3/role_assignments?group.id=c2af1b3f513f47208dc1d8e0b9f72799&scope.project.id=92436548309e4b6f9ccf5357c5fb8342&role.id=2e42b82a17a84744960aa3904ab682cc => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:18:54.815732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167219e7-8e71-4efc-b1d4-c1a6ece3136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:54.816651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167219e7-8e71-4efc-b1d4-c1a6ece3136d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:54.817050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167219e7-8e71-4efc-b1d4-c1a6ece3136d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:54.817332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167219e7-8e71-4efc-b1d4-c1a6ece3136d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:54.818087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167219e7-8e71-4efc-b1d4-c1a6ece3136d None admin] RBAC: Adding query filter params (group.id=e8eff8acfeda4f21bb0d8d01b354219e, role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=7911c9363a5f49a3b74eb85a8f08a450) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:54.818394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167219e7-8e71-4efc-b1d4-c1a6ece3136d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:54.819944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167219e7-8e71-4efc-b1d4-c1a6ece3136d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:54.827364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 227/455] 10.222.0.78 () {56 vars in 1376 bytes} [Wed Aug 24 03:18:54 2022] GET /identity/v3/role_assignments?group.id=e8eff8acfeda4f21bb0d8d01b354219e&scope.project.id=7911c9363a5f49a3b74eb85a8f08a450&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:57.445246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822902b-8431-4b35-bec1-7d75e43941fd None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:57.445774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822902b-8431-4b35-bec1-7d75e43941fd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:57.445774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822902b-8431-4b35-bec1-7d75e43941fd None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:57.448098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 229/456] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:57.449632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4f8d4-4a4e-4fc2-a8b5-8074ed9a5ded None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:57.450045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4f8d4-4a4e-4fc2-a8b5-8074ed9a5ded None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:57.450214 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4f8d4-4a4e-4fc2-a8b5-8074ed9a5ded None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:57.453030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60e726-77aa-49ef-899b-caf6e36b8516 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:57.453308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60e726-77aa-49ef-899b-caf6e36b8516 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:57.453578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60e726-77aa-49ef-899b-caf6e36b8516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:57.455770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 228/457] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:57.457073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720da284-87cf-49ce-aafe-facc7b07b082 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:57.457396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720da284-87cf-49ce-aafe-facc7b07b082 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:57.457899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720da284-87cf-49ce-aafe-facc7b07b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:57.490834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-720da284-87cf-49ce-aafe-facc7b07b082 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:57.492063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-720da284-87cf-49ce-aafe-facc7b07b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:57.493689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6a60e726-77aa-49ef-899b-caf6e36b8516 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:57.494870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6a60e726-77aa-49ef-899b-caf6e36b8516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:57.578199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:57.637284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 229/458] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:57.659319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 230/459] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:57.819737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfe848-8e1a-43fb-86ae-f0b105c2ead2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:57.819913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfe848-8e1a-43fb-86ae-f0b105c2ead2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:57.820195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfe848-8e1a-43fb-86ae-f0b105c2ead2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:57.821867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 230/460] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:57.828977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88242-3fc4-419a-9e09-6665e73dac7b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:57.829342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88242-3fc4-419a-9e09-6665e73dac7b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:57.829557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88242-3fc4-419a-9e09-6665e73dac7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:57.859775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8ea88242-3fc4-419a-9e09-6665e73dac7b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:57.860995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8ea88242-3fc4-419a-9e09-6665e73dac7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:57.968800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 231/461] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:58.013223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfe848-8e1a-43fb-86ae-f0b105c2ead2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:58.107659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88242-3fc4-419a-9e09-6665e73dac7b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:58.158601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:58.169078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfe848-8e1a-43fb-86ae-f0b105c2ead2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:58.220354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773ea9-a0e5-4bfb-b523-4864a2aa6f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:58.221469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773ea9-a0e5-4bfb-b523-4864a2aa6f1e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.221762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773ea9-a0e5-4bfb-b523-4864a2aa6f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.222027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773ea9-a0e5-4bfb-b523-4864a2aa6f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.236681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773ea9-a0e5-4bfb-b523-4864a2aa6f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:58.238331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773ea9-a0e5-4bfb-b523-4864a2aa6f1e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:58.248948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88242-3fc4-419a-9e09-6665e73dac7b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:58.253146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-2f773ea9-a0e5-4bfb-b523-4864a2aa6f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:18:58.258791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:58.259731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:18:58.260554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:18:58.260554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:18:58.260554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:58.260554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 231/462] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:58.262684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ba34-4f95-4ec5-aa8e-8a82b392ba84 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.262684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ba34-4f95-4ec5-aa8e-8a82b392ba84 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.262684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ba34-4f95-4ec5-aa8e-8a82b392ba84 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.263744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 232/463] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:58.269002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208832f8-bd4b-43ee-84c4-9b45818a1c30 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.269283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208832f8-bd4b-43ee-84c4-9b45818a1c30 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.269556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208832f8-bd4b-43ee-84c4-9b45818a1c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.295605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-208832f8-bd4b-43ee-84c4-9b45818a1c30 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:58.296838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-208832f8-bd4b-43ee-84c4-9b45818a1c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:58.308932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2229e0c-9f53-459e-88f1-baea60583dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:58.309628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2229e0c-9f53-459e-88f1-baea60583dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.309907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2229e0c-9f53-459e-88f1-baea60583dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.310176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2229e0c-9f53-459e-88f1-baea60583dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.322012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2229e0c-9f53-459e-88f1-baea60583dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:58.323885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2229e0c-9f53-459e-88f1-baea60583dd2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-c2229e0c-9f53-459e-88f1-baea60583dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:18:58.339406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:58.340401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:18:58.343689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:18:58.343689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:18:58.343689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:58.343689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 232/464] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:58.343689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2229e0c-9f53-459e-88f1-baea60583dd2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:58.382971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 233/465] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:58.383748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208832f8-bd4b-43ee-84c4-9b45818a1c30 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:58.458782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2229e0c-9f53-459e-88f1-baea60583dd2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:58.487047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:58.507269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182d53d-3a39-471e-be79-12aaf2617d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:58.508053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182d53d-3a39-471e-be79-12aaf2617d1c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.508541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182d53d-3a39-471e-be79-12aaf2617d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.509041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182d53d-3a39-471e-be79-12aaf2617d1c None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.509916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182d53d-3a39-471e-be79-12aaf2617d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:58.510424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182d53d-3a39-471e-be79-12aaf2617d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:58.512027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182d53d-3a39-471e-be79-12aaf2617d1c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:58.517734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208832f8-bd4b-43ee-84c4-9b45818a1c30 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:58.526513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 233/466] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:58.527740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182d53d-3a39-471e-be79-12aaf2617d1c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:58.551760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:58.565175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0b9a8-7695-4779-ab99-cbacb7fd7e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:58.565745 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0b9a8-7695-4779-ab99-cbacb7fd7e48 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.566023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0b9a8-7695-4779-ab99-cbacb7fd7e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.566344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0b9a8-7695-4779-ab99-cbacb7fd7e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.578060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0b9a8-7695-4779-ab99-cbacb7fd7e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:58.579904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0b9a8-7695-4779-ab99-cbacb7fd7e48 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-cfa0b9a8-7695-4779-ab99-cbacb7fd7e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:18:58.595607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:58.596568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:18:58.597377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:18:58.597377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:18:58.597377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:58.602118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 234/467] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:58.602836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0b9a8-7695-4779-ab99-cbacb7fd7e48 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:58.656277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182d53d-3a39-471e-be79-12aaf2617d1c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:58.708350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d94bb-3876-41e5-b30c-e76894c59dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:58.709854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d94bb-3876-41e5-b30c-e76894c59dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.710415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d94bb-3876-41e5-b30c-e76894c59dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.710904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d94bb-3876-41e5-b30c-e76894c59dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.711736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d94bb-3876-41e5-b30c-e76894c59dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:58.711996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0b9a8-7695-4779-ab99-cbacb7fd7e48 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:58.712388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d94bb-3876-41e5-b30c-e76894c59dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:58.714944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d94bb-3876-41e5-b30c-e76894c59dd2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:58.728041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 234/468] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:58.728696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d94bb-3876-41e5-b30c-e76894c59dd2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:58.752825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:58.759782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e275786-b28b-488f-9257-3923a41e72e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:58.760463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e275786-b28b-488f-9257-3923a41e72e1 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.760742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e275786-b28b-488f-9257-3923a41e72e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.761013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e275786-b28b-488f-9257-3923a41e72e1 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.761830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e275786-b28b-488f-9257-3923a41e72e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:58.763512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e275786-b28b-488f-9257-3923a41e72e1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:58.789683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 235/469] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:58 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:58.791121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e275786-b28b-488f-9257-3923a41e72e1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:58.841975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:58.879125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d94bb-3876-41e5-b30c-e76894c59dd2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:58.919112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ca20-b5e4-488e-a86a-491da76d4d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:58.919689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ca20-b5e4-488e-a86a-491da76d4d8f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.919967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ca20-b5e4-488e-a86a-491da76d4d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.920243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ca20-b5e4-488e-a86a-491da76d4d8f None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.920906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ca20-b5e4-488e-a86a-491da76d4d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:58.921208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ca20-b5e4-488e-a86a-491da76d4d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:58.922635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ca20-b5e4-488e-a86a-491da76d4d8f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:58.933407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e275786-b28b-488f-9257-3923a41e72e1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:58.936500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 235/470] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:58.937260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ca20-b5e4-488e-a86a-491da76d4d8f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:58.975762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbe727-9207-4451-94d5-0fbc461bb4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:58.976471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbe727-9207-4451-94d5-0fbc461bb4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:58.976755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbe727-9207-4451-94d5-0fbc461bb4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:58.977019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbe727-9207-4451-94d5-0fbc461bb4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:58.990822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbe727-9207-4451-94d5-0fbc461bb4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:58.992399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbe727-9207-4451-94d5-0fbc461bb4f2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3dfbe727-9207-4451-94d5-0fbc461bb4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:18:59.014070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:18:59.015087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:18:59.015921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:18:59.015921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:18:59.015921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:18:59.015921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 236/471] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:59.017085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456e59f-8cf5-40cd-baf0-e76320d8d303 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:59.017363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456e59f-8cf5-40cd-baf0-e76320d8d303 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:59.017633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456e59f-8cf5-40cd-baf0-e76320d8d303 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:59.022701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 237/472] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:18:59.022701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456e59f-8cf5-40cd-baf0-e76320d8d303 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:59.078978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:59.082383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ca20-b5e4-488e-a86a-491da76d4d8f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:59.127867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81768-6089-4cc4-8e65-460c05a6ddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:59.128710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81768-6089-4cc4-8e65-460c05a6ddba None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:59.128895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81768-6089-4cc4-8e65-460c05a6ddba None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:59.129121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81768-6089-4cc4-8e65-460c05a6ddba None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:59.129949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a81768-6089-4cc4-8e65-460c05a6ddba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:59.132044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a81768-6089-4cc4-8e65-460c05a6ddba None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:59.141977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:59.160200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456e59f-8cf5-40cd-baf0-e76320d8d303 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:59.166966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 236/473] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:58 2022] POST /identity/v3/users => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:59.168845 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81768-6089-4cc4-8e65-460c05a6ddba None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:59.215878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62981a-9595-449a-b394-672e9ebc8e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:59.216625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62981a-9595-449a-b394-672e9ebc8e06 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:59.217052 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62981a-9595-449a-b394-672e9ebc8e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:59.217495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62981a-9595-449a-b394-672e9ebc8e06 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:59.218258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62981a-9595-449a-b394-672e9ebc8e06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:59.220600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62981a-9595-449a-b394-672e9ebc8e06 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:59.249074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 238/474] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:59 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:59.250626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9efde-9564-45ea-a28b-9cf91978f5a9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:59.250877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9efde-9564-45ea-a28b-9cf91978f5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:59.251173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9efde-9564-45ea-a28b-9cf91978f5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:59.273291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-dcc9efde-9564-45ea-a28b-9cf91978f5a9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:18:59.274669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dcc9efde-9564-45ea-a28b-9cf91978f5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:18:59.344819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81768-6089-4cc4-8e65-460c05a6ddba None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:59.371359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 239/475] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:18:59.402528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ba025-e5ed-40c9-ba3d-7da51482fa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:59.403207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba025-e5ed-40c9-ba3d-7da51482fa0a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:59.403477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba025-e5ed-40c9-ba3d-7da51482fa0a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:59.403743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba025-e5ed-40c9-ba3d-7da51482fa0a None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:59.404411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ba025-e5ed-40c9-ba3d-7da51482fa0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:18:59.404710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ba025-e5ed-40c9-ba3d-7da51482fa0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:59.406101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ba025-e5ed-40c9-ba3d-7da51482fa0a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:59.420731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 237/476] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:18:59.426247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9efde-9564-45ea-a28b-9cf91978f5a9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:59.459005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:59.550102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9efde-9564-45ea-a28b-9cf91978f5a9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:59.596748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011748a2-ae55-4a28-a26d-60c723a37673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:59.597730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011748a2-ae55-4a28-a26d-60c723a37673 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:59.598433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011748a2-ae55-4a28-a26d-60c723a37673 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:59.598965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011748a2-ae55-4a28-a26d-60c723a37673 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:59.599816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011748a2-ae55-4a28-a26d-60c723a37673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:59.601478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011748a2-ae55-4a28-a26d-60c723a37673 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:59.634460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 240/477] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:18:59 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:18:59.656132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ba025-e5ed-40c9-ba3d-7da51482fa0a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:59.727614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:59.798881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ba025-e5ed-40c9-ba3d-7da51482fa0a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:18:59.844389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:18:59.844923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:18:59.845196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:18:59.845463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:18:59.846145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:18:59.847537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:18:59.858387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.sql.core [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:18:59.858387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 03:18:59.858387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [parameters: {'id': '1e69b7a6d88e4945b77ed403155e6f8f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 03:18:59.858387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 03:18:59.875670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:18:59.876607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application yield resource Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise self.value Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application session.commit() Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:18:59.877544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:18:59.878409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:18:59.879817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:18:59.880625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [parameters: {'id': '1e69b7a6d88e4945b77ed403155e6f8f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:18:59.881412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 03:18:59.888485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:18:59.890446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 238/478] 10.222.0.78 () {60 vars in 1131 bytes} [Wed Aug 24 03:18:59 2022] POST /identity/v3/roles => generated 144 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:18:59.890583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011748a2-ae55-4a28-a26d-60c723a37673 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:18:59.979475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:00.002536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011748a2-ae55-4a28-a26d-60c723a37673 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:00.038622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bf07e-8937-4890-b2d9-150d5d6d324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:00.039305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bf07e-8937-4890-b2d9-150d5d6d324f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:00.039579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bf07e-8937-4890-b2d9-150d5d6d324f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:00.039845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bf07e-8937-4890-b2d9-150d5d6d324f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:00.054025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bf07e-8937-4890-b2d9-150d5d6d324f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-292bf07e-8937-4890-b2d9-150d5d6d324f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:00.059272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:00.061288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:00.062937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 241/479] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:18:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:00.066906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:00.175681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd295e8-1c6c-420b-b773-882a2b5b3fd5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:00.202226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:00.228312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29be67-3010-4839-87ed-9a339ed38a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:00.228940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29be67-3010-4839-87ed-9a339ed38a10 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:00.229211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29be67-3010-4839-87ed-9a339ed38a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:00.229475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29be67-3010-4839-87ed-9a339ed38a10 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:00.230156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29be67-3010-4839-87ed-9a339ed38a10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:00.230457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29be67-3010-4839-87ed-9a339ed38a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:00.231859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29be67-3010-4839-87ed-9a339ed38a10 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:00.246502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 239/480] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:01.233336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834c19-6739-4d59-96d3-b8d1bbad81fb None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:01.233903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834c19-6739-4d59-96d3-b8d1bbad81fb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:01.233903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834c19-6739-4d59-96d3-b8d1bbad81fb None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:01.235246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 242/481] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:01.241187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da713716-62f6-44d9-be36-0c0c54597d8b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:01.241644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da713716-62f6-44d9-be36-0c0c54597d8b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:01.241716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da713716-62f6-44d9-be36-0c0c54597d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:01.275463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-da713716-62f6-44d9-be36-0c0c54597d8b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:01.276708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-da713716-62f6-44d9-be36-0c0c54597d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:01.403496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 240/482] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:19:01.620621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae55f3-91e3-473e-9f74-a5d0ba5ca92c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:01.620959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae55f3-91e3-473e-9f74-a5d0ba5ca92c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:01.621188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae55f3-91e3-473e-9f74-a5d0ba5ca92c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:01.622707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 243/483] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:01.630687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f022-a5e3-4065-a7a3-f7411235fb57 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:01.630687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f022-a5e3-4065-a7a3-f7411235fb57 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:01.630687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f022-a5e3-4065-a7a3-f7411235fb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:01.659484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3779f022-a5e3-4065-a7a3-f7411235fb57 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:01.661211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3779f022-a5e3-4065-a7a3-f7411235fb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:01.800194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae55f3-91e3-473e-9f74-a5d0ba5ca92c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:01.815205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 241/484] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:01.899092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e5a59-24a1-4fec-b05b-1bdc3f0258d6 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:01.899287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e5a59-24a1-4fec-b05b-1bdc3f0258d6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:01.899762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e5a59-24a1-4fec-b05b-1bdc3f0258d6 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:01.901546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 242/485] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:01.907273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ad376-2e09-4e9a-a9f2-1117de455043 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:01.907795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ad376-2e09-4e9a-a9f2-1117de455043 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:01.908240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ad376-2e09-4e9a-a9f2-1117de455043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:01.938691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f91ad376-2e09-4e9a-a9f2-1117de455043 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:01.938691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f91ad376-2e09-4e9a-a9f2-1117de455043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:01.941091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae55f3-91e3-473e-9f74-a5d0ba5ca92c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.003060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:02.012246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684d5cb-c821-40b4-8abd-acc0e3eec281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:02.012892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684d5cb-c821-40b4-8abd-acc0e3eec281 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.013182 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684d5cb-c821-40b4-8abd-acc0e3eec281 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.013449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684d5cb-c821-40b4-8abd-acc0e3eec281 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.037363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:02.051606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684d5cb-c821-40b4-8abd-acc0e3eec281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:02.054456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 243/486] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f684d5cb-c821-40b4-8abd-acc0e3eec281 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:02.056476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:02.057344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:02.058363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 244/487] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:02.076850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ad376-2e09-4e9a-a9f2-1117de455043 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:02.125163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684d5cb-c821-40b4-8abd-acc0e3eec281 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:02.204445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ad376-2e09-4e9a-a9f2-1117de455043 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.248543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1bbd7-13cc-4c82-9de9-e831f814062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:02.250188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1bbd7-13cc-4c82-9de9-e831f814062a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.250714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1bbd7-13cc-4c82-9de9-e831f814062a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.251169 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1bbd7-13cc-4c82-9de9-e831f814062a None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.252082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1bbd7-13cc-4c82-9de9-e831f814062a None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:02.252575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1bbd7-13cc-4c82-9de9-e831f814062a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:02.254191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1bbd7-13cc-4c82-9de9-e831f814062a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:02.268640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 244/488] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:02.270725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1bbd7-13cc-4c82-9de9-e831f814062a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:02.288066 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684d5cb-c821-40b4-8abd-acc0e3eec281 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.324675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:02.351031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a7197-8d4a-4225-ab6f-2897c858e7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:02.352073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7197-8d4a-4225-ab6f-2897c858e7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.352539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7197-8d4a-4225-ab6f-2897c858e7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.353086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7197-8d4a-4225-ab6f-2897c858e7a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.367352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a7197-8d4a-4225-ab6f-2897c858e7a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-609a7197-8d4a-4225-ab6f-2897c858e7a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:02.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:02.373835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:02.375106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 245/489] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:02.375937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a7197-8d4a-4225-ab6f-2897c858e7a5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:02.407608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1bbd7-13cc-4c82-9de9-e831f814062a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.454362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9010ce4-bbc1-49ea-adbb-ac47724aa3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:02.455083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9010ce4-bbc1-49ea-adbb-ac47724aa3ed None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.455293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9010ce4-bbc1-49ea-adbb-ac47724aa3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.455558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9010ce4-bbc1-49ea-adbb-ac47724aa3ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.458108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:02.469495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9010ce4-bbc1-49ea-adbb-ac47724aa3ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:02.471391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9010ce4-bbc1-49ea-adbb-ac47724aa3ed None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-f9010ce4-bbc1-49ea-adbb-ac47724aa3ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:02.488153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:02.489303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:02.490221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:02.490221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:02.490221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:02.490221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 245/490] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:02.490467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9010ce4-bbc1-49ea-adbb-ac47724aa3ed None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:02.512164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a7197-8d4a-4225-ab6f-2897c858e7a5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.550524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae8fb5-4b5a-4fa3-b655-55dc1f21e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:02.551543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae8fb5-4b5a-4fa3-b655-55dc1f21e625 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.551812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae8fb5-4b5a-4fa3-b655-55dc1f21e625 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.552078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae8fb5-4b5a-4fa3-b655-55dc1f21e625 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.562945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae8fb5-4b5a-4fa3-b655-55dc1f21e625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-51ae8fb5-4b5a-4fa3-b655-55dc1f21e625 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:02.568067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:02.569008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:02.569813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 246/491] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:02.570447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bd672-fb42-40cb-8d52-2725a1de9c78 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.576989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bd672-fb42-40cb-8d52-2725a1de9c78 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.576989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bd672-fb42-40cb-8d52-2725a1de9c78 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.576989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 247/492] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:02.576989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bd672-fb42-40cb-8d52-2725a1de9c78 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:02.585879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:02.613876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9010ce4-bbc1-49ea-adbb-ac47724aa3ed None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.650661 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39127-9191-4b20-81fd-af0a723bfabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:02.651307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39127-9191-4b20-81fd-af0a723bfabb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.651560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39127-9191-4b20-81fd-af0a723bfabb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.651822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39127-9191-4b20-81fd-af0a723bfabb None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.652545 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce39127-9191-4b20-81fd-af0a723bfabb None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:02.652775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce39127-9191-4b20-81fd-af0a723bfabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:02.654179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce39127-9191-4b20-81fd-af0a723bfabb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:02.667410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 246/493] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:02.667410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39127-9191-4b20-81fd-af0a723bfabb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:02.694245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bd672-fb42-40cb-8d52-2725a1de9c78 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.718055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:02.736690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c808ce-f031-4c74-923a-642794bfc87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:02.737303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c808ce-f031-4c74-923a-642794bfc87f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.737573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c808ce-f031-4c74-923a-642794bfc87f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.737836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c808ce-f031-4c74-923a-642794bfc87f None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.738736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c808ce-f031-4c74-923a-642794bfc87f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:02.739071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c808ce-f031-4c74-923a-642794bfc87f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:02.741259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c808ce-f031-4c74-923a-642794bfc87f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:02.767354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 248/494] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:02.767354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde307f-8fd3-45ff-99a1-5a86b818e24e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.767354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde307f-8fd3-45ff-99a1-5a86b818e24e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.767354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde307f-8fd3-45ff-99a1-5a86b818e24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.778331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39127-9191-4b20-81fd-af0a723bfabb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.789715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ddde307f-8fd3-45ff-99a1-5a86b818e24e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:02.791629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ddde307f-8fd3-45ff-99a1-5a86b818e24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:02.815539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141d60c-ca83-44e0-ba53-5acdfacc785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:02.816385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141d60c-ca83-44e0-ba53-5acdfacc785c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:02.816544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141d60c-ca83-44e0-ba53-5acdfacc785c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:02.817213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141d60c-ca83-44e0-ba53-5acdfacc785c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:02.818205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141d60c-ca83-44e0-ba53-5acdfacc785c None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:02.818576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141d60c-ca83-44e0-ba53-5acdfacc785c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:02.820141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141d60c-ca83-44e0-ba53-5acdfacc785c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:02.829277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 247/495] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:02.831153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141d60c-ca83-44e0-ba53-5acdfacc785c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:02.843069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:02.883065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 249/496] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:02.883984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde307f-8fd3-45ff-99a1-5a86b818e24e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:02.960241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141d60c-ca83-44e0-ba53-5acdfacc785c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.999409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde307f-8fd3-45ff-99a1-5a86b818e24e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:02.999596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146e26d-d73c-49bd-b021-97bcc88fbcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.000079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146e26d-d73c-49bd-b021-97bcc88fbcfa None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.000352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146e26d-d73c-49bd-b021-97bcc88fbcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.000616 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146e26d-d73c-49bd-b021-97bcc88fbcfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.012012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:03.012202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146e26d-d73c-49bd-b021-97bcc88fbcfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:03.013475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146e26d-d73c-49bd-b021-97bcc88fbcfa None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-d146e26d-d73c-49bd-b021-97bcc88fbcfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:03.029013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:03.029982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:03.031249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:03.031249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:03.031249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:03.031249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 248/497] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:03.031249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146e26d-d73c-49bd-b021-97bcc88fbcfa None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.043629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a31dc-9fe9-43db-9e57-8014cbd4c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.044691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a31dc-9fe9-43db-9e57-8014cbd4c61f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.044971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a31dc-9fe9-43db-9e57-8014cbd4c61f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.045233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a31dc-9fe9-43db-9e57-8014cbd4c61f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.055519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a31dc-9fe9-43db-9e57-8014cbd4c61f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:03.057192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a31dc-9fe9-43db-9e57-8014cbd4c61f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-973a31dc-9fe9-43db-9e57-8014cbd4c61f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:03.071679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:03.072666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:03.073950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 250/498] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:03.075151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54995ca-b0c7-477a-9218-c38d7f7a9332 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.075151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54995ca-b0c7-477a-9218-c38d7f7a9332 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.075151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54995ca-b0c7-477a-9218-c38d7f7a9332 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.080717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 251/499] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:03.080717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54995ca-b0c7-477a-9218-c38d7f7a9332 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.115027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:03.165256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146e26d-d73c-49bd-b021-97bcc88fbcfa None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:03.189305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54995ca-b0c7-477a-9218-c38d7f7a9332 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:03.202305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5995b-d932-4114-8dca-d2b76ca4cfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.203054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5995b-d932-4114-8dca-d2b76ca4cfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.203328 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5995b-d932-4114-8dca-d2b76ca4cfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.203601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5995b-d932-4114-8dca-d2b76ca4cfe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.215473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5995b-d932-4114-8dca-d2b76ca4cfe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:03.216936 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5995b-d932-4114-8dca-d2b76ca4cfe4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:03.226646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562bbb7-ea84-41f3-b5f5-06fa1a05dfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.227288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562bbb7-ea84-41f3-b5f5-06fa1a05dfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.227563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562bbb7-ea84-41f3-b5f5-06fa1a05dfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.227829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562bbb7-ea84-41f3-b5f5-06fa1a05dfb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.228473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562bbb7-ea84-41f3-b5f5-06fa1a05dfb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:03.228772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562bbb7-ea84-41f3-b5f5-06fa1a05dfb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:03.230159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562bbb7-ea84-41f3-b5f5-06fa1a05dfb0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-dfa5995b-d932-4114-8dca-d2b76ca4cfe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:03.232081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:03.233117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:03.234144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:03.234144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:03.234144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:03.234144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 249/500] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:03.234416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5995b-d932-4114-8dca-d2b76ca4cfe4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.244241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 252/501] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:03.245741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051935-0c6d-4c25-bc75-d8ca3fb9a90c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.245942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051935-0c6d-4c25-bc75-d8ca3fb9a90c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.246273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051935-0c6d-4c25-bc75-d8ca3fb9a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.265813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-51051935-0c6d-4c25-bc75-d8ca3fb9a90c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:03.266984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-51051935-0c6d-4c25-bc75-d8ca3fb9a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:03.293989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:03.339499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 253/502] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:03.340329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51051935-0c6d-4c25-bc75-d8ca3fb9a90c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.354056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5995b-d932-4114-8dca-d2b76ca4cfe4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:03.365442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:03.392621 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89c790-beb3-46a7-a4cc-338b7c359883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.393383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89c790-beb3-46a7-a4cc-338b7c359883 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.393809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89c790-beb3-46a7-a4cc-338b7c359883 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.394176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89c790-beb3-46a7-a4cc-338b7c359883 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.395101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89c790-beb3-46a7-a4cc-338b7c359883 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:03.395695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89c790-beb3-46a7-a4cc-338b7c359883 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:03.397177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89c790-beb3-46a7-a4cc-338b7c359883 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:03.436940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 250/503] 10.222.0.78 () {56 vars in 1137 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:03.438012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89c790-beb3-46a7-a4cc-338b7c359883 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.453315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51051935-0c6d-4c25-bc75-d8ca3fb9a90c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:03.489913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13fc4d-367e-42c7-8c1e-b6206e31b2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.490556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13fc4d-367e-42c7-8c1e-b6206e31b2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.490867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13fc4d-367e-42c7-8c1e-b6206e31b2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.491142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13fc4d-367e-42c7-8c1e-b6206e31b2a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.502891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13fc4d-367e-42c7-8c1e-b6206e31b2a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-4b13fc4d-367e-42c7-8c1e-b6206e31b2a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:03.508006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:03.509145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:03.510046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 254/504] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:03.510816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13fc4d-367e-42c7-8c1e-b6206e31b2a5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.534415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:03.554584 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89c790-beb3-46a7-a4cc-338b7c359883 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:03.596585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11604d34-cc20-446e-a324-c838ad311a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.597244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11604d34-cc20-446e-a324-c838ad311a79 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.597481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11604d34-cc20-446e-a324-c838ad311a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.597753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11604d34-cc20-446e-a324-c838ad311a79 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.598556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11604d34-cc20-446e-a324-c838ad311a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:03.598920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11604d34-cc20-446e-a324-c838ad311a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:03.600361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11604d34-cc20-446e-a324-c838ad311a79 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:03.613781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 251/505] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:03.614493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11604d34-cc20-446e-a324-c838ad311a79 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.628502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13fc4d-367e-42c7-8c1e-b6206e31b2a5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:03.643646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:03.663194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdab73-d636-49e9-95e8-1e84c30eaca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.663923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdab73-d636-49e9-95e8-1e84c30eaca9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.664197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdab73-d636-49e9-95e8-1e84c30eaca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.664463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdab73-d636-49e9-95e8-1e84c30eaca9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.672591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdab73-d636-49e9-95e8-1e84c30eaca9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:03.674007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdab73-d636-49e9-95e8-1e84c30eaca9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-98cdab73-d636-49e9-95e8-1e84c30eaca9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:03.685773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:03.686731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:03.687596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 255/506] 10.222.0.78 () {56 vars in 1093 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:03.688760 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdab73-d636-49e9-95e8-1e84c30eaca9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.716168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11604d34-cc20-446e-a324-c838ad311a79 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:03.763663 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802f2e5-62d9-41a7-814b-726c23509600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.764300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f2e5-62d9-41a7-814b-726c23509600 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.764575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f2e5-62d9-41a7-814b-726c23509600 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.764905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f2e5-62d9-41a7-814b-726c23509600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.781379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:03.804609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdab73-d636-49e9-95e8-1e84c30eaca9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:03.842294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8afb9-4a42-413c-8bbf-aebcecef2d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.842920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8afb9-4a42-413c-8bbf-aebcecef2d09 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.843188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8afb9-4a42-413c-8bbf-aebcecef2d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.843453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8afb9-4a42-413c-8bbf-aebcecef2d09 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:03.844119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8afb9-4a42-413c-8bbf-aebcecef2d09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:03.844418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8afb9-4a42-413c-8bbf-aebcecef2d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:03.845360 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802f2e5-62d9-41a7-814b-726c23509600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:03.845808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8afb9-4a42-413c-8bbf-aebcecef2d09 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:03.846876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802f2e5-62d9-41a7-814b-726c23509600 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:03.854792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 256/507] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:03.855643 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8afb9-4a42-413c-8bbf-aebcecef2d09 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.879886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:03.953938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 252/508] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:03.954831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802f2e5-62d9-41a7-814b-726c23509600 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:03.956951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8afb9-4a42-413c-8bbf-aebcecef2d09 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:03.994209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01588c-767b-474a-b3da-8115f3484685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:03.994878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01588c-767b-474a-b3da-8115f3484685 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:03.995162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01588c-767b-474a-b3da-8115f3484685 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:03.995433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01588c-767b-474a-b3da-8115f3484685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.007189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01588c-767b-474a-b3da-8115f3484685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.008772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01588c-767b-474a-b3da-8115f3484685 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.010608 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-9e01588c-767b-474a-b3da-8115f3484685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:04.025471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:04.026616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:04.027537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:04.027537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:04.027537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:04.027537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 257/509] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:04.028133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01588c-767b-474a-b3da-8115f3484685 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:04.064726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802f2e5-62d9-41a7-814b-726c23509600 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:04.095592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:04.105930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b5e3c-a675-48b4-acb4-e2bee4f7ff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:04.106755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b5e3c-a675-48b4-acb4-e2bee4f7ff54 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:04.107040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b5e3c-a675-48b4-acb4-e2bee4f7ff54 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:04.107307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b5e3c-a675-48b4-acb4-e2bee4f7ff54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.115591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b5e3c-a675-48b4-acb4-e2bee4f7ff54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.117274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b5e3c-a675-48b4-acb4-e2bee4f7ff54 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-993b5e3c-a675-48b4-acb4-e2bee4f7ff54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:04.131534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:04.133072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 253/510] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:04.133940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b5e3c-a675-48b4-acb4-e2bee4f7ff54 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:04.152114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01588c-767b-474a-b3da-8115f3484685 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:04.189783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc638b1-957e-4b3a-8841-63c0e0b0383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:04.190396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc638b1-957e-4b3a-8841-63c0e0b0383e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:04.190689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc638b1-957e-4b3a-8841-63c0e0b0383e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:04.190957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc638b1-957e-4b3a-8841-63c0e0b0383e None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.191864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc638b1-957e-4b3a-8841-63c0e0b0383e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:04.192781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc638b1-957e-4b3a-8841-63c0e0b0383e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.194235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc638b1-957e-4b3a-8841-63c0e0b0383e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.233624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 258/511] 10.222.0.78 () {56 vars in 1133 bytes} [Wed Aug 24 03:19:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:04.234871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc638b1-957e-4b3a-8841-63c0e0b0383e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:04.259411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b5e3c-a675-48b4-acb4-e2bee4f7ff54 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:04.294856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:04.300798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5d21a-dea3-420a-8ad7-6ca9b205f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:04.301642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5d21a-dea3-420a-8ad7-6ca9b205f599 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:04.301932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5d21a-dea3-420a-8ad7-6ca9b205f599 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:04.302188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5d21a-dea3-420a-8ad7-6ca9b205f599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.314228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5d21a-dea3-420a-8ad7-6ca9b205f599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.315760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5d21a-dea3-420a-8ad7-6ca9b205f599 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-a4e5d21a-dea3-420a-8ad7-6ca9b205f599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:04.334012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:04.335079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:04.335933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:04.335933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:04.335933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:04.336093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 254/512] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:04.337105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5d21a-dea3-420a-8ad7-6ca9b205f599 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:04.350174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc638b1-957e-4b3a-8841-63c0e0b0383e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:04.381091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:04.389618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb18bd-53f8-405c-aa0f-dc27be86de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:04.390258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb18bd-53f8-405c-aa0f-dc27be86de95 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:04.390533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb18bd-53f8-405c-aa0f-dc27be86de95 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:04.390832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb18bd-53f8-405c-aa0f-dc27be86de95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.401244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb18bd-53f8-405c-aa0f-dc27be86de95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.402720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb18bd-53f8-405c-aa0f-dc27be86de95 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8fcb18bd-53f8-405c-aa0f-dc27be86de95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:04.417545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:04.418518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:04.419415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:04.419415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:04.419415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:04.419415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 259/513] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:04.419828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb18bd-53f8-405c-aa0f-dc27be86de95 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:04.457567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5d21a-dea3-420a-8ad7-6ca9b205f599 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:04.493702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e97f63-5276-4f63-b0ac-a84e565e7034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:04.494385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e97f63-5276-4f63-b0ac-a84e565e7034 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:04.494688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e97f63-5276-4f63-b0ac-a84e565e7034 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:04.494962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e97f63-5276-4f63-b0ac-a84e565e7034 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.495703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e97f63-5276-4f63-b0ac-a84e565e7034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:04.496133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e97f63-5276-4f63-b0ac-a84e565e7034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.497652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e97f63-5276-4f63-b0ac-a84e565e7034 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.511260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 255/514] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:04.512198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e97f63-5276-4f63-b0ac-a84e565e7034 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:04.548748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb18bd-53f8-405c-aa0f-dc27be86de95 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:04.552094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:04.591445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a59fdc-b57c-481e-9de4-9bc3ecc8e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:04.591977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a59fdc-b57c-481e-9de4-9bc3ecc8e646 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:04.592255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a59fdc-b57c-481e-9de4-9bc3ecc8e646 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:04.592524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a59fdc-b57c-481e-9de4-9bc3ecc8e646 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.593295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a59fdc-b57c-481e-9de4-9bc3ecc8e646 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:04.593594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a59fdc-b57c-481e-9de4-9bc3ecc8e646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.595068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a59fdc-b57c-481e-9de4-9bc3ecc8e646 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.613050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 260/515] 10.222.0.78 () {56 vars in 1137 bytes} [Wed Aug 24 03:19:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:04.613948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a59fdc-b57c-481e-9de4-9bc3ecc8e646 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:04.623508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:04.628502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e97f63-5276-4f63-b0ac-a84e565e7034 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:04.664922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e764-9093-4c57-bac0-845a760546e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:04.665545 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e764-9093-4c57-bac0-845a760546e2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:04.665823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e764-9093-4c57-bac0-845a760546e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:04.666088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e764-9093-4c57-bac0-845a760546e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.720188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a59fdc-b57c-481e-9de4-9bc3ecc8e646 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:04.735872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920e764-9093-4c57-bac0-845a760546e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.737369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920e764-9093-4c57-bac0-845a760546e2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.761013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569056b1-b7ce-4e91-aaa5-deebcd996765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:04.761727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569056b1-b7ce-4e91-aaa5-deebcd996765 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:04.762059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569056b1-b7ce-4e91-aaa5-deebcd996765 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:04.762336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569056b1-b7ce-4e91-aaa5-deebcd996765 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.763102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569056b1-b7ce-4e91-aaa5-deebcd996765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:04.763404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569056b1-b7ce-4e91-aaa5-deebcd996765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.764863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569056b1-b7ce-4e91-aaa5-deebcd996765 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.777145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 261/516] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:04.778018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569056b1-b7ce-4e91-aaa5-deebcd996765 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:04.809301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:04.868375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:04.873022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 256/517] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:04.874899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e764-9093-4c57-bac0-845a760546e2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:04.900272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569056b1-b7ce-4e91-aaa5-deebcd996765 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:04.938717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7d2dc-2a31-464f-ad49-61df165a7eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:04.939339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7d2dc-2a31-464f-ad49-61df165a7eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:04.939659 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7d2dc-2a31-464f-ad49-61df165a7eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:04.939921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7d2dc-2a31-464f-ad49-61df165a7eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:04.940568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7d2dc-2a31-464f-ad49-61df165a7eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:04.940864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7d2dc-2a31-464f-ad49-61df165a7eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:04.942598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7d2dc-2a31-464f-ad49-61df165a7eb4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:04.957640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 262/518] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:04.958934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7d2dc-2a31-464f-ad49-61df165a7eb4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:05.010175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e764-9093-4c57-bac0-845a760546e2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:05.054338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65c6ae-0023-4384-aac4-b2faea06e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:05.055009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65c6ae-0023-4384-aac4-b2faea06e5c5 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:05.055283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65c6ae-0023-4384-aac4-b2faea06e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:05.055547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65c6ae-0023-4384-aac4-b2faea06e5c5 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:05.056212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65c6ae-0023-4384-aac4-b2faea06e5c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:05.057767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65c6ae-0023-4384-aac4-b2faea06e5c5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:05.075722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:05.081208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 257/519] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:19:04 2022] POST /identity/v3/users => generated 247 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:19:05.082024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65c6ae-0023-4384-aac4-b2faea06e5c5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:05.106864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7d2dc-2a31-464f-ad49-61df165a7eb4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:05.149391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e655e-49c3-4546-a06a-a8bf257b449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:05.149932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e655e-49c3-4546-a06a-a8bf257b449a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:05.150213 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e655e-49c3-4546-a06a-a8bf257b449a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:05.150484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e655e-49c3-4546-a06a-a8bf257b449a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:05.154516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:05.211355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65c6ae-0023-4384-aac4-b2faea06e5c5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:05.226706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e655e-49c3-4546-a06a-a8bf257b449a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:05.228603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e655e-49c3-4546-a06a-a8bf257b449a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:05.252762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f6c3-de75-4adb-bd23-ba6363c900ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:05.253117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f6c3-de75-4adb-bd23-ba6363c900ac None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:05.253960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f6c3-de75-4adb-bd23-ba6363c900ac None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:05.253960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f6c3-de75-4adb-bd23-ba6363c900ac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:05.264572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6f6c3-de75-4adb-bd23-ba6363c900ac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:05.266077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6f6c3-de75-4adb-bd23-ba6363c900ac None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-2eb6f6c3-de75-4adb-bd23-ba6363c900ac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:05.283839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:05.284858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:05.285860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 258/520] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:05.286447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f6c3-de75-4adb-bd23-ba6363c900ac None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:05.330903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:05.359966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 263/521] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:05.361037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e655e-49c3-4546-a06a-a8bf257b449a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:05.435803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f6c3-de75-4adb-bd23-ba6363c900ac None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:05.460523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:05.483307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856be4c-820a-4046-8744-dd6807fc6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:05.483949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856be4c-820a-4046-8744-dd6807fc6679 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:05.484223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856be4c-820a-4046-8744-dd6807fc6679 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:05.484489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856be4c-820a-4046-8744-dd6807fc6679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:05.491449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e655e-49c3-4546-a06a-a8bf257b449a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:05.498941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856be4c-820a-4046-8744-dd6807fc6679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:05.500427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856be4c-820a-4046-8744-dd6807fc6679 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-3856be4c-820a-4046-8744-dd6807fc6679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:05.518630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:05.519904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:05.520992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:05.520992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:05.520992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:05.520992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 259/522] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:05.520992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856be4c-820a-4046-8744-dd6807fc6679 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:05.540504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ee07c-ccd7-47bc-94a5-60943c837292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:05.541156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ee07c-ccd7-47bc-94a5-60943c837292 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:05.541404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ee07c-ccd7-47bc-94a5-60943c837292 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:05.541677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ee07c-ccd7-47bc-94a5-60943c837292 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:05.549268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ee07c-ccd7-47bc-94a5-60943c837292 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:05.550767 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ee07c-ccd7-47bc-94a5-60943c837292 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-2f2ee07c-ccd7-47bc-94a5-60943c837292 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:05.563802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:05.564839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:05.565682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:05.565682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:05.565682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:05.565682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:05.565682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:05.565682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:05.565682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:05.565682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:05.565682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 264/523] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:05.566227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ee07c-ccd7-47bc-94a5-60943c837292 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:05.631583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:05.665656 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856be4c-820a-4046-8744-dd6807fc6679 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:05.704523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e86d5-f482-49c7-894f-c0aaa97f0fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:05.705375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e86d5-f482-49c7-894f-c0aaa97f0fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:05.705804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e86d5-f482-49c7-894f-c0aaa97f0fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:05.706071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e86d5-f482-49c7-894f-c0aaa97f0fa8 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:05.706858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e86d5-f482-49c7-894f-c0aaa97f0fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:05.707265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e86d5-f482-49c7-894f-c0aaa97f0fa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:05.708614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ee07c-ccd7-47bc-94a5-60943c837292 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:05.709344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e86d5-f482-49c7-894f-c0aaa97f0fa8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:05.736193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 260/524] 10.222.0.78 () {56 vars in 1139 bytes} [Wed Aug 24 03:19:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:05.736193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e86d5-f482-49c7-894f-c0aaa97f0fa8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:05.755165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf96cd-2009-4294-a8d7-98f1ca0c5829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:05.755820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf96cd-2009-4294-a8d7-98f1ca0c5829 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:05.756099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf96cd-2009-4294-a8d7-98f1ca0c5829 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:05.756372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf96cd-2009-4294-a8d7-98f1ca0c5829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:05.768806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf96cd-2009-4294-a8d7-98f1ca0c5829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:05.771146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf96cd-2009-4294-a8d7-98f1ca0c5829 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:05.774416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1bbf96cd-2009-4294-a8d7-98f1ca0c5829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:05.790215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:05.791292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:05.792135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:05.792135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:05.792135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:05.792135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 265/525] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:05.792802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf96cd-2009-4294-a8d7-98f1ca0c5829 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:05.874354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e86d5-f482-49c7-894f-c0aaa97f0fa8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:05.913645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4062d-1b13-42d9-b188-acaccc414f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:05.914378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:05.914638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4062d-1b13-42d9-b188-acaccc414f24 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:05.914941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4062d-1b13-42d9-b188-acaccc414f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:05.915212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4062d-1b13-42d9-b188-acaccc414f24 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:05.916260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4062d-1b13-42d9-b188-acaccc414f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:05.916640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4062d-1b13-42d9-b188-acaccc414f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:05.918143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4062d-1b13-42d9-b188-acaccc414f24 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:05.923067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf96cd-2009-4294-a8d7-98f1ca0c5829 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:05.935580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 261/526] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:05.936811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4062d-1b13-42d9-b188-acaccc414f24 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:05.963847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36e29b-b6f4-4052-bed3-8e53bf4b52af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:05.964473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36e29b-b6f4-4052-bed3-8e53bf4b52af None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:05.964753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36e29b-b6f4-4052-bed3-8e53bf4b52af None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:05.965023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36e29b-b6f4-4052-bed3-8e53bf4b52af None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:05.965733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36e29b-b6f4-4052-bed3-8e53bf4b52af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:05.966035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36e29b-b6f4-4052-bed3-8e53bf4b52af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:05.967554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36e29b-b6f4-4052-bed3-8e53bf4b52af None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:05.998060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 266/527] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:05.998060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36e29b-b6f4-4052-bed3-8e53bf4b52af None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:06.059108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:06.080053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4062d-1b13-42d9-b188-acaccc414f24 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:06.118795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a243c8-3eba-4aa2-ac8a-f7b63f26242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:06.119407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a243c8-3eba-4aa2-ac8a-f7b63f26242a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:06.119680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a243c8-3eba-4aa2-ac8a-f7b63f26242a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:06.119986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a243c8-3eba-4aa2-ac8a-f7b63f26242a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:06.121210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36e29b-b6f4-4052-bed3-8e53bf4b52af None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:06.162585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d32c30-50be-43b5-b3d2-bbce136914af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:06.163262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32c30-50be-43b5-b3d2-bbce136914af None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:06.163612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32c30-50be-43b5-b3d2-bbce136914af None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:06.163886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32c30-50be-43b5-b3d2-bbce136914af None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:06.164649 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d32c30-50be-43b5-b3d2-bbce136914af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:06.164952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d32c30-50be-43b5-b3d2-bbce136914af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:06.166698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d32c30-50be-43b5-b3d2-bbce136914af None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:06.183641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 267/528] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:06.183641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d32c30-50be-43b5-b3d2-bbce136914af None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:06.200025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:06.213999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a243c8-3eba-4aa2-ac8a-f7b63f26242a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:06.216095 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a243c8-3eba-4aa2-ac8a-f7b63f26242a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:06.313035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d32c30-50be-43b5-b3d2-bbce136914af None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:06.320521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:06.337934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 262/529] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:06.343189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a243c8-3eba-4aa2-ac8a-f7b63f26242a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:06.356609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695411df-9171-45bc-9e20-91626d08735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:06.357631 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695411df-9171-45bc-9e20-91626d08735d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:06.358032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695411df-9171-45bc-9e20-91626d08735d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:06.358353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695411df-9171-45bc-9e20-91626d08735d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:06.366050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695411df-9171-45bc-9e20-91626d08735d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:06.367520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695411df-9171-45bc-9e20-91626d08735d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-695411df-9171-45bc-9e20-91626d08735d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:06.378768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:06.379639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:06.380462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:06.380462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:06.380462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:06.380462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:06.380462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:06.380462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:06.380462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:06.380462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:06.380462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 268/530] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:06.380912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695411df-9171-45bc-9e20-91626d08735d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:06.473673 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a243c8-3eba-4aa2-ac8a-f7b63f26242a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:06.505898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:06.514434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f9f6c-4f29-4554-a4ef-e590b28e9966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:06.515081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f9f6c-4f29-4554-a4ef-e590b28e9966 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:06.515352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f9f6c-4f29-4554-a4ef-e590b28e9966 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:06.515615 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f9f6c-4f29-4554-a4ef-e590b28e9966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:06.516351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f9f6c-4f29-4554-a4ef-e590b28e9966 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=d6c0b33c2c7947c59ebf8da17abbd0b6) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:06.516660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f9f6c-4f29-4554-a4ef-e590b28e9966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:06.518097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f9f6c-4f29-4554-a4ef-e590b28e9966 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:06.525055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 263/531] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:06 2022] GET /identity/v3/role_assignments?user.id=d6c0b33c2c7947c59ebf8da17abbd0b6&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:06.527527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f9f6c-4f29-4554-a4ef-e590b28e9966 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:06.538324 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695411df-9171-45bc-9e20-91626d08735d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:06.581073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d215fc-90ef-4e09-ba8f-d6f154b21abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:06.582228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d215fc-90ef-4e09-ba8f-d6f154b21abc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:06.582950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d215fc-90ef-4e09-ba8f-d6f154b21abc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:06.583508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d215fc-90ef-4e09-ba8f-d6f154b21abc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:06.592029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d215fc-90ef-4e09-ba8f-d6f154b21abc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:06.593840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d215fc-90ef-4e09-ba8f-d6f154b21abc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:06.594209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-67d215fc-90ef-4e09-ba8f-d6f154b21abc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:06.609792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:06.610728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:06.612067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:06.612067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:06.612067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:06.612067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:06.612067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:06.612067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:06.612067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:06.612067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:06.615020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 269/532] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:06.616195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d215fc-90ef-4e09-ba8f-d6f154b21abc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:06.668279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f9f6c-4f29-4554-a4ef-e590b28e9966 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:06.705933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76c69-6f89-4341-b6d3-cf967f16e680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:06.707119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76c69-6f89-4341-b6d3-cf967f16e680 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:06.707119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76c69-6f89-4341-b6d3-cf967f16e680 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:06.707487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76c69-6f89-4341-b6d3-cf967f16e680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:06.719514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d76c69-6f89-4341-b6d3-cf967f16e680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:06.721237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d76c69-6f89-4341-b6d3-cf967f16e680 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-d7d76c69-6f89-4341-b6d3-cf967f16e680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:06.737282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:06.738997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:06.740783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:06.740783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:06.740783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:06.740783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 264/533] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:06.740783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76c69-6f89-4341-b6d3-cf967f16e680 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:06.752256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d215fc-90ef-4e09-ba8f-d6f154b21abc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:06.796429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aabf3e-75e0-4c1f-a5b6-9918eae5b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:06.797311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aabf3e-75e0-4c1f-a5b6-9918eae5b909 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:06.797739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aabf3e-75e0-4c1f-a5b6-9918eae5b909 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:06.798430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aabf3e-75e0-4c1f-a5b6-9918eae5b909 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:06.799422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aabf3e-75e0-4c1f-a5b6-9918eae5b909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:06.799931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aabf3e-75e0-4c1f-a5b6-9918eae5b909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:06.803150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aabf3e-75e0-4c1f-a5b6-9918eae5b909 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:06.805229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:06.825479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 270/534] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:06.827411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aabf3e-75e0-4c1f-a5b6-9918eae5b909 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:06.861376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76c69-6f89-4341-b6d3-cf967f16e680 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:06.862917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:06.897653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba7022-9fe5-416a-846c-0f9714cb1095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:06.898407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba7022-9fe5-416a-846c-0f9714cb1095 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:06.898580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba7022-9fe5-416a-846c-0f9714cb1095 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:06.898837 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba7022-9fe5-416a-846c-0f9714cb1095 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:06.899549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba7022-9fe5-416a-846c-0f9714cb1095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:06.899856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba7022-9fe5-416a-846c-0f9714cb1095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:06.901316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba7022-9fe5-416a-846c-0f9714cb1095 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:06.924740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 265/535] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:06.926517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba7022-9fe5-416a-846c-0f9714cb1095 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:06.960292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aabf3e-75e0-4c1f-a5b6-9918eae5b909 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:06.999361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c991e2b-da4b-43cc-a244-a0d8916b9d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:07.000433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c991e2b-da4b-43cc-a244-a0d8916b9d54 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:07.000895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c991e2b-da4b-43cc-a244-a0d8916b9d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:07.001420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c991e2b-da4b-43cc-a244-a0d8916b9d54 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:07.002359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c991e2b-da4b-43cc-a244-a0d8916b9d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:07.002875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c991e2b-da4b-43cc-a244-a0d8916b9d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:07.004560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c991e2b-da4b-43cc-a244-a0d8916b9d54 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:07.018413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 271/536] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:07.019764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c991e2b-da4b-43cc-a244-a0d8916b9d54 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:07.032939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba7022-9fe5-416a-846c-0f9714cb1095 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:07.069691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec97a-833a-4b6f-8dec-2fc60d4ac0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:07.070305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec97a-833a-4b6f-8dec-2fc60d4ac0ed None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:07.070582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec97a-833a-4b6f-8dec-2fc60d4ac0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:07.070885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec97a-833a-4b6f-8dec-2fc60d4ac0ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:07.071909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ec97a-833a-4b6f-8dec-2fc60d4ac0ed None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=438786dead414066a6ef101a2493fb8c) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:07.071909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ec97a-833a-4b6f-8dec-2fc60d4ac0ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:07.073734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ec97a-833a-4b6f-8dec-2fc60d4ac0ed None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:07.086149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 266/537] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:06 2022] GET /identity/v3/role_assignments?user.id=438786dead414066a6ef101a2493fb8c&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:07.087652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec97a-833a-4b6f-8dec-2fc60d4ac0ed None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:07.092203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:07.129871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:07.156807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c991e2b-da4b-43cc-a244-a0d8916b9d54 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:07.211115 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0bc73-1400-4981-8d67-5a07eafa3cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:07.212798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0bc73-1400-4981-8d67-5a07eafa3cae None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:07.213403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0bc73-1400-4981-8d67-5a07eafa3cae None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:07.213843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0bc73-1400-4981-8d67-5a07eafa3cae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:07.215068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0bc73-1400-4981-8d67-5a07eafa3cae None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=e736e983399140c2a7e6ee2c9e297021) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:07.216065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0bc73-1400-4981-8d67-5a07eafa3cae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:07.218218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0bc73-1400-4981-8d67-5a07eafa3cae None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:07.223003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec97a-833a-4b6f-8dec-2fc60d4ac0ed None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:07.227981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 272/538] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:07 2022] GET /identity/v3/role_assignments?user.id=e736e983399140c2a7e6ee2c9e297021&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:07.229571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a606a-da64-4934-b31d-82be9e2457f3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:07.230031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a606a-da64-4934-b31d-82be9e2457f3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:07.230466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a606a-da64-4934-b31d-82be9e2457f3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:07.232348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 273/539] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:07.240850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecf571-df0b-4a25-a42f-3d7210f85faf None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:07.241768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecf571-df0b-4a25-a42f-3d7210f85faf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:07.242482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecf571-df0b-4a25-a42f-3d7210f85faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:07.281262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-42ecf571-df0b-4a25-a42f-3d7210f85faf None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:07.283874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-42ecf571-df0b-4a25-a42f-3d7210f85faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:07.348867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337ea5f-7794-4165-9c92-1c0e4ba166a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:07.349091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337ea5f-7794-4165-9c92-1c0e4ba166a6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:07.349276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337ea5f-7794-4165-9c92-1c0e4ba166a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:07.349547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337ea5f-7794-4165-9c92-1c0e4ba166a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:07.365515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337ea5f-7794-4165-9c92-1c0e4ba166a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:07.368136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337ea5f-7794-4165-9c92-1c0e4ba166a6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8337ea5f-7794-4165-9c92-1c0e4ba166a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:07.394179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:07.395304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:07.396131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:07.396131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:07.396131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:07.396131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:07.396131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:07.396131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:07.396131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:07.396131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:07.399793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 267/540] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:07.403899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337ea5f-7794-4165-9c92-1c0e4ba166a6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:07.412397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 274/541] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:07.497692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:07.513480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337ea5f-7794-4165-9c92-1c0e4ba166a6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:07.549401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1510b-b92a-40d7-b541-aaaca0dff63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:07.549932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1510b-b92a-40d7-b541-aaaca0dff63f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:07.550208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1510b-b92a-40d7-b541-aaaca0dff63f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:07.550481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1510b-b92a-40d7-b541-aaaca0dff63f None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:07.551265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1510b-b92a-40d7-b541-aaaca0dff63f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:07.551572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1510b-b92a-40d7-b541-aaaca0dff63f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:07.553043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1510b-b92a-40d7-b541-aaaca0dff63f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:07.566778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 268/542] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:07.575619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecf571-df0b-4a25-a42f-3d7210f85faf None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:07.661133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:07.731724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecf571-df0b-4a25-a42f-3d7210f85faf None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:07.807439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1510b-b92a-40d7-b541-aaaca0dff63f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:07.810321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77229f9-4ad5-440e-ac9a-50d121618ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:07.811359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77229f9-4ad5-440e-ac9a-50d121618ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:07.811821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77229f9-4ad5-440e-ac9a-50d121618ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:07.812307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77229f9-4ad5-440e-ac9a-50d121618ed8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:07.813642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77229f9-4ad5-440e-ac9a-50d121618ed8 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=0e7bc56706f2491b92f5745a0fbc2acd) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:07.814167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77229f9-4ad5-440e-ac9a-50d121618ed8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:07.816988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77229f9-4ad5-440e-ac9a-50d121618ed8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:07.834242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 275/543] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:07 2022] GET /identity/v3/role_assignments?user.id=0e7bc56706f2491b92f5745a0fbc2acd&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:08.006999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1510b-b92a-40d7-b541-aaaca0dff63f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:08.070109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5a9a-5388-4be8-aa02-bc5bcec130ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:08.071166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5a9a-5388-4be8-aa02-bc5bcec130ad None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:08.071649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5a9a-5388-4be8-aa02-bc5bcec130ad None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:08.072131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5a9a-5388-4be8-aa02-bc5bcec130ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:08.092441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5a9a-5388-4be8-aa02-bc5bcec130ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-20ab5a9a-5388-4be8-aa02-bc5bcec130ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:08.102376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:08.103371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:08.104153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:08.105268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 269/544] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:08.112192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77229f9-4ad5-440e-ac9a-50d121618ed8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:08.273159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77229f9-4ad5-440e-ac9a-50d121618ed8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:08.296256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:08.325167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db0567-d2d1-4ec4-9643-6d31aeadfef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:08.325705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db0567-d2d1-4ec4-9643-6d31aeadfef5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:08.325982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db0567-d2d1-4ec4-9643-6d31aeadfef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:08.326250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db0567-d2d1-4ec4-9643-6d31aeadfef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:08.326955 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db0567-d2d1-4ec4-9643-6d31aeadfef5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:08.327260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db0567-d2d1-4ec4-9643-6d31aeadfef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:08.328644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db0567-d2d1-4ec4-9643-6d31aeadfef5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:08.338017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 276/545] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:08.344004 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5a9a-5388-4be8-aa02-bc5bcec130ad None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:08.357535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:08.494800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5a9a-5388-4be8-aa02-bc5bcec130ad None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:08.545462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe3f7a-649f-4f07-bf14-3196a30e6bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:08.546126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe3f7a-649f-4f07-bf14-3196a30e6bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:08.546377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe3f7a-649f-4f07-bf14-3196a30e6bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:08.546611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe3f7a-649f-4f07-bf14-3196a30e6bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:08.559250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe3f7a-649f-4f07-bf14-3196a30e6bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:08.560809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe3f7a-649f-4f07-bf14-3196a30e6bb6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-7cfe3f7a-649f-4f07-bf14-3196a30e6bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:08.580406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:08.581326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:08.582346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:08.582346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:08.582346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:08.582346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 270/546] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:08.588685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db0567-d2d1-4ec4-9643-6d31aeadfef5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:08.748571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db0567-d2d1-4ec4-9643-6d31aeadfef5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:08.785898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33676-c23b-449b-9a73-d356e138160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:08.786936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33676-c23b-449b-9a73-d356e138160d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:08.787403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33676-c23b-449b-9a73-d356e138160d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:08.787934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33676-c23b-449b-9a73-d356e138160d None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:08.788775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf33676-c23b-449b-9a73-d356e138160d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:08.789278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf33676-c23b-449b-9a73-d356e138160d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:08.790905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf33676-c23b-449b-9a73-d356e138160d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:08.805392 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 277/547] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:08.811329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe3f7a-649f-4f07-bf14-3196a30e6bb6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:08.893750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:08.942825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe3f7a-649f-4f07-bf14-3196a30e6bb6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:08.982330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bcefa-44e9-4569-a808-e2d0e5b176ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:08.982998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bcefa-44e9-4569-a808-e2d0e5b176ac None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:08.983273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bcefa-44e9-4569-a808-e2d0e5b176ac None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:08.983527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bcefa-44e9-4569-a808-e2d0e5b176ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:08.989442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09d454-0772-47ad-8bc1-75d45aab0004 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:08.990103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09d454-0772-47ad-8bc1-75d45aab0004 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:08.990615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09d454-0772-47ad-8bc1-75d45aab0004 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:08.992560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 278/548] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:08.992666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bcefa-44e9-4569-a808-e2d0e5b176ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:08.996199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bcefa-44e9-4569-a808-e2d0e5b176ac None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:08.998549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650e62-d68b-4727-8144-8458aa52a136 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:08.999063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650e62-d68b-4727-8144-8458aa52a136 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:08.999535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650e62-d68b-4727-8144-8458aa52a136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-633bcefa-44e9-4569-a808-e2d0e5b176ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:09.015374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:09.016940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:09.017968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 271/549] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:09.028152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-07650e62-d68b-4727-8144-8458aa52a136 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:09.028321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bcefa-44e9-4569-a808-e2d0e5b176ac None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:09.029811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-07650e62-d68b-4727-8144-8458aa52a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:09.062920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:09.154119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 279/550] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:19:09.211479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bcefa-44e9-4569-a808-e2d0e5b176ac None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:09.234161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:09.258049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b6498-c365-4abc-83ce-569e8675de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:09.258772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b6498-c365-4abc-83ce-569e8675de52 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:09.259053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b6498-c365-4abc-83ce-569e8675de52 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:09.259351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b6498-c365-4abc-83ce-569e8675de52 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:09.260287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b6498-c365-4abc-83ce-569e8675de52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:09.260599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b6498-c365-4abc-83ce-569e8675de52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:09.262115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b6498-c365-4abc-83ce-569e8675de52 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:09.288053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 272/551] 10.222.0.78 () {56 vars in 1135 bytes} [Wed Aug 24 03:19:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:09.295402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650e62-d68b-4727-8144-8458aa52a136 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:09.437201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650e62-d68b-4727-8144-8458aa52a136 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:09.474444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4197f-a37b-456b-8896-7ec091193220 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:09.475016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4197f-a37b-456b-8896-7ec091193220 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:09.475016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4197f-a37b-456b-8896-7ec091193220 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:09.477105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 273/552] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:09.484536 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa449d9-a41d-484b-8607-b349e92c4402 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:09.484863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa449d9-a41d-484b-8607-b349e92c4402 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:09.485068 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa449d9-a41d-484b-8607-b349e92c4402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:09.492157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e330fbe-8c80-4ed7-9322-79a539420a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:09.493291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e330fbe-8c80-4ed7-9322-79a539420a7e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:09.493886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e330fbe-8c80-4ed7-9322-79a539420a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:09.494339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e330fbe-8c80-4ed7-9322-79a539420a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:09.504967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bfa449d9-a41d-484b-8607-b349e92c4402 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:09.506290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bfa449d9-a41d-484b-8607-b349e92c4402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:09.546062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:09.591376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 274/553] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:19:09.592266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa449d9-a41d-484b-8607-b349e92c4402 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:09.603125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e330fbe-8c80-4ed7-9322-79a539420a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:09.605372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e330fbe-8c80-4ed7-9322-79a539420a7e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:09.740122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 280/554] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:09.745852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e330fbe-8c80-4ed7-9322-79a539420a7e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:09.793226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa449d9-a41d-484b-8607-b349e92c4402 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:09.801399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:09.819313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:09.829851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d069db-1c94-46f6-bdb5-bbc830c5c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:09.830629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d069db-1c94-46f6-bdb5-bbc830c5c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:09.831029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d069db-1c94-46f6-bdb5-bbc830c5c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:09.831391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d069db-1c94-46f6-bdb5-bbc830c5c6d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:09.842911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d069db-1c94-46f6-bdb5-bbc830c5c6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-97d069db-1c94-46f6-bdb5-bbc830c5c6d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:09.847993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:09.848965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:09.849954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 275/555] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:09.855078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d069db-1c94-46f6-bdb5-bbc830c5c6d9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:09.870993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e330fbe-8c80-4ed7-9322-79a539420a7e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:09.912757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b9c8-8124-4be2-940f-6bab8c13b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:09.913404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b9c8-8124-4be2-940f-6bab8c13b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:09.913680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b9c8-8124-4be2-940f-6bab8c13b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:09.913950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b9c8-8124-4be2-940f-6bab8c13b0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:09.926851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678b9c8-8124-4be2-940f-6bab8c13b0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:09.928428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678b9c8-8124-4be2-940f-6bab8c13b0d7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c678b9c8-8124-4be2-940f-6bab8c13b0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:09.945106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:09.946149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:09.947462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:09.947462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:09.947462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:09.947462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 281/556] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:09.949130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a9a6-9a49-4bfb-9cdd-94e74974d1d5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:09.949130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a9a6-9a49-4bfb-9cdd-94e74974d1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:09.949130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a9a6-9a49-4bfb-9cdd-94e74974d1d5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:09.954323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 282/557] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:09.955342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2a9a6-9a49-4bfb-9cdd-94e74974d1d5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:09.962286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d069db-1c94-46f6-bdb5-bbc830c5c6d9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.003346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e519a1-ede5-49f9-9032-a511a5b620b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.004249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e519a1-ede5-49f9-9032-a511a5b620b6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.004521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e519a1-ede5-49f9-9032-a511a5b620b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.004787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e519a1-ede5-49f9-9032-a511a5b620b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.005591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e519a1-ede5-49f9-9032-a511a5b620b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:10.005901 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e519a1-ede5-49f9-9032-a511a5b620b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:10.007395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e519a1-ede5-49f9-9032-a511a5b620b6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:10.016837 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 276/558] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:10.017850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2977-a782-4c1a-8174-d5d4522b6a64 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.018125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2977-a782-4c1a-8174-d5d4522b6a64 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.018389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2977-a782-4c1a-8174-d5d4522b6a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.038346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-728e2977-a782-4c1a-8174-d5d4522b6a64 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:10.040396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-728e2977-a782-4c1a-8174-d5d4522b6a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:10.066694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:10.091410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2a9a6-9a49-4bfb-9cdd-94e74974d1d5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.109681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:10.129310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 277/559] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:10.130246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2977-a782-4c1a-8174-d5d4522b6a64 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:10.135914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ff507-46a5-461c-a1fd-9cab0d6f202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.136685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ff507-46a5-461c-a1fd-9cab0d6f202e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.137062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ff507-46a5-461c-a1fd-9cab0d6f202e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.137467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ff507-46a5-461c-a1fd-9cab0d6f202e None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.138260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ff507-46a5-461c-a1fd-9cab0d6f202e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:10.138703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ff507-46a5-461c-a1fd-9cab0d6f202e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:10.140650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ff507-46a5-461c-a1fd-9cab0d6f202e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:10.160989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 283/560] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:10.160989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ff507-46a5-461c-a1fd-9cab0d6f202e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:10.280777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2977-a782-4c1a-8174-d5d4522b6a64 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.311616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ff507-46a5-461c-a1fd-9cab0d6f202e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.339745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161dee75-7cfa-4012-a471-8e258ac4a47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.340756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161dee75-7cfa-4012-a471-8e258ac4a47b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.341212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161dee75-7cfa-4012-a471-8e258ac4a47b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.341892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161dee75-7cfa-4012-a471-8e258ac4a47b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.354989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161dee75-7cfa-4012-a471-8e258ac4a47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-161dee75-7cfa-4012-a471-8e258ac4a47b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:10.359877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:10.360804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:10.361604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:10.366292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 278/561] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:10.366629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a935-6304-4e99-9b20-fa119f7152fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.367279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161dee75-7cfa-4012-a471-8e258ac4a47b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:10.367875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a935-6304-4e99-9b20-fa119f7152fa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.368339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a935-6304-4e99-9b20-fa119f7152fa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.368907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a935-6304-4e99-9b20-fa119f7152fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.380777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3a935-6304-4e99-9b20-fa119f7152fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:10.382718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3a935-6304-4e99-9b20-fa119f7152fa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:10.390255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-29a3a935-6304-4e99-9b20-fa119f7152fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:10.400698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:10.401699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:10.402563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:10.402563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:10.402563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:10.409100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 284/562] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:10.410825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a935-6304-4e99-9b20-fa119f7152fa None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:10.450938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:10.490367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161dee75-7cfa-4012-a471-8e258ac4a47b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.529132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00115a-1a2b-4fe4-86cf-13285c52719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.529759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00115a-1a2b-4fe4-86cf-13285c52719a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.530030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00115a-1a2b-4fe4-86cf-13285c52719a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.530295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00115a-1a2b-4fe4-86cf-13285c52719a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.537326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a935-6304-4e99-9b20-fa119f7152fa None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.537834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00115a-1a2b-4fe4-86cf-13285c52719a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:10.539361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00115a-1a2b-4fe4-86cf-13285c52719a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-0a00115a-1a2b-4fe4-86cf-13285c52719a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:10.551219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:10.552833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 279/563] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:10.553734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00115a-1a2b-4fe4-86cf-13285c52719a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:10.577343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc318ed4-4c72-4d54-801f-5e36a24fc571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.577961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc318ed4-4c72-4d54-801f-5e36a24fc571 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.578229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc318ed4-4c72-4d54-801f-5e36a24fc571 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.578497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc318ed4-4c72-4d54-801f-5e36a24fc571 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.579377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc318ed4-4c72-4d54-801f-5e36a24fc571 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:10.579675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc318ed4-4c72-4d54-801f-5e36a24fc571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:10.581051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc318ed4-4c72-4d54-801f-5e36a24fc571 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:10.593677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 285/564] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:10.594570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc318ed4-4c72-4d54-801f-5e36a24fc571 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:10.651612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:10.683238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00115a-1a2b-4fe4-86cf-13285c52719a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.717257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:10.719343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb798b60-748c-43f9-b33c-6ac41bdd49bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.719929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb798b60-748c-43f9-b33c-6ac41bdd49bc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.720203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb798b60-748c-43f9-b33c-6ac41bdd49bc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.720501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb798b60-748c-43f9-b33c-6ac41bdd49bc None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.721207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb798b60-748c-43f9-b33c-6ac41bdd49bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:10.721503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb798b60-748c-43f9-b33c-6ac41bdd49bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:10.722922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb798b60-748c-43f9-b33c-6ac41bdd49bc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:10.731329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc318ed4-4c72-4d54-801f-5e36a24fc571 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.738074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 280/565] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:10.739785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4cca-f49a-4219-b173-5dcae744c1af None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.740071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4cca-f49a-4219-b173-5dcae744c1af None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.740338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4cca-f49a-4219-b173-5dcae744c1af None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.741564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 281/566] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:10.743639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4cca-f49a-4219-b173-5dcae744c1af None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:10.779775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182701-9d94-48a4-8260-3f9e1b983f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.780417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182701-9d94-48a4-8260-3f9e1b983f51 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.780693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182701-9d94-48a4-8260-3f9e1b983f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.780959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182701-9d94-48a4-8260-3f9e1b983f51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.793786 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a182701-9d94-48a4-8260-3f9e1b983f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-9a182701-9d94-48a4-8260-3f9e1b983f51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:10.798935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:10.800630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 286/567] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:10.801986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182701-9d94-48a4-8260-3f9e1b983f51 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:10.870959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4cca-f49a-4219-b173-5dcae744c1af None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.909523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1503da-4258-4604-a2ba-5d78aeffe059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.910136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1503da-4258-4604-a2ba-5d78aeffe059 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.910477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1503da-4258-4604-a2ba-5d78aeffe059 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.910774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1503da-4258-4604-a2ba-5d78aeffe059 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.911485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1503da-4258-4604-a2ba-5d78aeffe059 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:10.911779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1503da-4258-4604-a2ba-5d78aeffe059 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:10.913216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1503da-4258-4604-a2ba-5d78aeffe059 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:10.913690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182701-9d94-48a4-8260-3f9e1b983f51 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:10.920427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:10.929027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 282/568] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:10.929867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1503da-4258-4604-a2ba-5d78aeffe059 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:10.962342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee048f4-e852-464b-95ae-9018020bda76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:10.963014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee048f4-e852-464b-95ae-9018020bda76 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.963292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee048f4-e852-464b-95ae-9018020bda76 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.963563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee048f4-e852-464b-95ae-9018020bda76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:10.979663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee048f4-e852-464b-95ae-9018020bda76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:10.981152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee048f4-e852-464b-95ae-9018020bda76 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-aee048f4-e852-464b-95ae-9018020bda76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:10.996033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:10.997183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:10.998184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:10.998184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:10.998184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:10.998184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 287/569] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:10.998414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab9ec-b97b-4e40-a8a4-3707604e9dd8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:10.998763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab9ec-b97b-4e40-a8a4-3707604e9dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:10.998921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab9ec-b97b-4e40-a8a4-3707604e9dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.005931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:11.019703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5c9ab9ec-b97b-4e40-a8a4-3707604e9dd8 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:11.020923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5c9ab9ec-b97b-4e40-a8a4-3707604e9dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:11.059257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1503da-4258-4604-a2ba-5d78aeffe059 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:11.095509 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526a344-de78-4086-be21-14d09e443338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:11.096198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a344-de78-4086-be21-14d09e443338 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:11.096477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a344-de78-4086-be21-14d09e443338 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:11.096743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a344-de78-4086-be21-14d09e443338 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.101283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 288/570] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:11.102144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ab9ec-b97b-4e40-a8a4-3707604e9dd8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.116124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526a344-de78-4086-be21-14d09e443338 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:11.117949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526a344-de78-4086-be21-14d09e443338 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8526a344-de78-4086-be21-14d09e443338 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:11.130736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:11.131770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 283/571] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:11.132682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526a344-de78-4086-be21-14d09e443338 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.193143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:11.210265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ab9ec-b97b-4e40-a8a4-3707604e9dd8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:11.237072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526a344-de78-4086-be21-14d09e443338 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:11.240006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:11.245622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1371e6-a3eb-4d7a-b11e-60fc49fe1a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:11.246234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1371e6-a3eb-4d7a-b11e-60fc49fe1a7b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:11.246507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1371e6-a3eb-4d7a-b11e-60fc49fe1a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:11.246802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1371e6-a3eb-4d7a-b11e-60fc49fe1a7b None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.247467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1371e6-a3eb-4d7a-b11e-60fc49fe1a7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:11.247762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1371e6-a3eb-4d7a-b11e-60fc49fe1a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:11.249133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1371e6-a3eb-4d7a-b11e-60fc49fe1a7b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:11.262044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 289/572] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:11.262044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1371e6-a3eb-4d7a-b11e-60fc49fe1a7b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.279003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1e7b-2615-40f3-8f76-b4363971fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:11.279609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1e7b-2615-40f3-8f76-b4363971fb0c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:11.279885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1e7b-2615-40f3-8f76-b4363971fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:11.280165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1e7b-2615-40f3-8f76-b4363971fb0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.280885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1e7b-2615-40f3-8f76-b4363971fb0c None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=c72dc03535044d6a97a953256839d413) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:11.281190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1e7b-2615-40f3-8f76-b4363971fb0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:11.282598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1e7b-2615-40f3-8f76-b4363971fb0c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:11.289229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 284/573] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/role_assignments?user.id=c72dc03535044d6a97a953256839d413&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:11.289946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1e7b-2615-40f3-8f76-b4363971fb0c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.398775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1371e6-a3eb-4d7a-b11e-60fc49fe1a7b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:11.452306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342c685-85ce-4471-99ba-c77110a09baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:11.452726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342c685-85ce-4471-99ba-c77110a09baf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:11.453006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342c685-85ce-4471-99ba-c77110a09baf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:11.453296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342c685-85ce-4471-99ba-c77110a09baf None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.453957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342c685-85ce-4471-99ba-c77110a09baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:11.454257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342c685-85ce-4471-99ba-c77110a09baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:11.456170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1e7b-2615-40f3-8f76-b4363971fb0c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:11.456398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342c685-85ce-4471-99ba-c77110a09baf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:11.471399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 290/574] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:11.472408 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342c685-85ce-4471-99ba-c77110a09baf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.483797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:11.497516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcb431-4b41-4431-9f56-df01e40eb80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:11.498126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcb431-4b41-4431-9f56-df01e40eb80c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:11.498688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcb431-4b41-4431-9f56-df01e40eb80c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:11.498688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcb431-4b41-4431-9f56-df01e40eb80c None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.499448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcb431-4b41-4431-9f56-df01e40eb80c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:11.499784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcb431-4b41-4431-9f56-df01e40eb80c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:11.501198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcb431-4b41-4431-9f56-df01e40eb80c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:11.524521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 285/575] 10.222.0.78 () {56 vars in 1137 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:11.524521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcb431-4b41-4431-9f56-df01e40eb80c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.542697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:11.596524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342c685-85ce-4471-99ba-c77110a09baf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:11.636276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d412e-22ae-4454-bd8f-fe984decbc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:11.637058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d412e-22ae-4454-bd8f-fe984decbc53 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:11.637438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d412e-22ae-4454-bd8f-fe984decbc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:11.637799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d412e-22ae-4454-bd8f-fe984decbc53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.643629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcb431-4b41-4431-9f56-df01e40eb80c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:11.649145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d412e-22ae-4454-bd8f-fe984decbc53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:11.650540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d412e-22ae-4454-bd8f-fe984decbc53 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d93d412e-22ae-4454-bd8f-fe984decbc53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:11.665807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:11.666816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:11.667660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:11.667660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:11.667660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:11.667660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 291/576] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:11.667893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d412e-22ae-4454-bd8f-fe984decbc53 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.693609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15ca7-3cda-4f67-bc29-8139cf70960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:11.694474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15ca7-3cda-4f67-bc29-8139cf70960e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:11.694581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15ca7-3cda-4f67-bc29-8139cf70960e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:11.694817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15ca7-3cda-4f67-bc29-8139cf70960e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.706578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f15ca7-3cda-4f67-bc29-8139cf70960e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-a8f15ca7-3cda-4f67-bc29-8139cf70960e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:11.711332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:11.712247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:11.713057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 286/577] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:11.713778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15ca7-3cda-4f67-bc29-8139cf70960e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.761145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:11.789525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d412e-22ae-4454-bd8f-fe984decbc53 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:11.798386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:11.831534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745302db-0cdf-467b-a593-9d82d79e3835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:11.832391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745302db-0cdf-467b-a593-9d82d79e3835 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:11.832780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745302db-0cdf-467b-a593-9d82d79e3835 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:11.833063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745302db-0cdf-467b-a593-9d82d79e3835 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.836499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15ca7-3cda-4f67-bc29-8139cf70960e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:11.841938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745302db-0cdf-467b-a593-9d82d79e3835 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:11.843444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745302db-0cdf-467b-a593-9d82d79e3835 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-745302db-0cdf-467b-a593-9d82d79e3835 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:11.857970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:11.859471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 292/578] 10.222.0.78 () {56 vars in 1093 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:11.861092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745302db-0cdf-467b-a593-9d82d79e3835 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.899858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd568-dede-48f8-95d5-13a1d5d69d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:11.902517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd568-dede-48f8-95d5-13a1d5d69d13 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:11.903072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd568-dede-48f8-95d5-13a1d5d69d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:11.903711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd568-dede-48f8-95d5-13a1d5d69d13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:11.918375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcd568-dede-48f8-95d5-13a1d5d69d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:11.919904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcd568-dede-48f8-95d5-13a1d5d69d13 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-43bcd568-dede-48f8-95d5-13a1d5d69d13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:11.936680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:11.937858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:11.938994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:11.938994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:11.938994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:11.942930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 287/579] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:11.944162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd568-dede-48f8-95d5-13a1d5d69d13 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:11.992063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745302db-0cdf-467b-a593-9d82d79e3835 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.032970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0559b20-df48-4fbe-934f-4c194b3b5c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:12.033690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0559b20-df48-4fbe-934f-4c194b3b5c99 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:12.034052 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0559b20-df48-4fbe-934f-4c194b3b5c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:12.034441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0559b20-df48-4fbe-934f-4c194b3b5c99 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:12.035659 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0559b20-df48-4fbe-934f-4c194b3b5c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:12.036079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0559b20-df48-4fbe-934f-4c194b3b5c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:12.037498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0559b20-df48-4fbe-934f-4c194b3b5c99 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:12.051543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 293/580] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:12.052422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0559b20-df48-4fbe-934f-4c194b3b5c99 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:12.066941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:12.081879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd568-dede-48f8-95d5-13a1d5d69d13 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.095795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:12.143810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fcbb1-0cb5-4511-a469-ad8a2958aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:12.144680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fcbb1-0cb5-4511-a469-ad8a2958aa63 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:12.145137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fcbb1-0cb5-4511-a469-ad8a2958aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:12.145572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fcbb1-0cb5-4511-a469-ad8a2958aa63 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:12.146759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fcbb1-0cb5-4511-a469-ad8a2958aa63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:12.147247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fcbb1-0cb5-4511-a469-ad8a2958aa63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:12.149570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fcbb1-0cb5-4511-a469-ad8a2958aa63 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:12.168445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 288/581] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:12.168445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fcbb1-0cb5-4511-a469-ad8a2958aa63 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:12.232819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0559b20-df48-4fbe-934f-4c194b3b5c99 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.287459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ff8b4-7ecb-47d2-8a7b-29c7020425ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:12.288083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ff8b4-7ecb-47d2-8a7b-29c7020425ab None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:12.288362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ff8b4-7ecb-47d2-8a7b-29c7020425ab None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:12.288629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ff8b4-7ecb-47d2-8a7b-29c7020425ab None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:12.289377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ff8b4-7ecb-47d2-8a7b-29c7020425ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:12.289708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ff8b4-7ecb-47d2-8a7b-29c7020425ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:12.291207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ff8b4-7ecb-47d2-8a7b-29c7020425ab None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:12.312132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fcbb1-0cb5-4511-a469-ad8a2958aa63 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.317157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 294/582] 10.222.0.78 () {56 vars in 1133 bytes} [Wed Aug 24 03:19:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:12.318919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ff8b4-7ecb-47d2-8a7b-29c7020425ab None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:12.361432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f1acb-2d4a-4ff7-8710-5dacbe3b9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:12.362125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f1acb-2d4a-4ff7-8710-5dacbe3b9e22 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:12.362391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f1acb-2d4a-4ff7-8710-5dacbe3b9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:12.362737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f1acb-2d4a-4ff7-8710-5dacbe3b9e22 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:12.363580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f1acb-2d4a-4ff7-8710-5dacbe3b9e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:12.363888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f1acb-2d4a-4ff7-8710-5dacbe3b9e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:12.365464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f1acb-2d4a-4ff7-8710-5dacbe3b9e22 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:12.383162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 289/583] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:12.384508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f1acb-2d4a-4ff7-8710-5dacbe3b9e22 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:12.404552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:12.439058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:12.467503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ff8b4-7ecb-47d2-8a7b-29c7020425ab None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.524179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252598da-38b6-4eab-9ae7-1a73b576bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:12.525007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252598da-38b6-4eab-9ae7-1a73b576bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:12.525940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252598da-38b6-4eab-9ae7-1a73b576bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:12.525940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252598da-38b6-4eab-9ae7-1a73b576bbb5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:12.534557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252598da-38b6-4eab-9ae7-1a73b576bbb5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:12.536162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252598da-38b6-4eab-9ae7-1a73b576bbb5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:12.537254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f1acb-2d4a-4ff7-8710-5dacbe3b9e22 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-252598da-38b6-4eab-9ae7-1a73b576bbb5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:12.548815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:12.549919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 295/584] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:12.552432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252598da-38b6-4eab-9ae7-1a73b576bbb5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:12.589645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e39c24-1b4b-4de2-902a-cdb12d8725ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:12.590596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e39c24-1b4b-4de2-902a-cdb12d8725ed None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:12.591113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e39c24-1b4b-4de2-902a-cdb12d8725ed None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:12.591572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e39c24-1b4b-4de2-902a-cdb12d8725ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:12.611916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e39c24-1b4b-4de2-902a-cdb12d8725ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:12.615188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e39c24-1b4b-4de2-902a-cdb12d8725ed None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-90e39c24-1b4b-4de2-902a-cdb12d8725ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:12.642944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:12.644034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:12.647967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:12.647967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:12.647967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:12.647967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 290/585] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:12.647967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e39c24-1b4b-4de2-902a-cdb12d8725ed None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:12.707664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252598da-38b6-4eab-9ae7-1a73b576bbb5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.730470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:12.750707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a55f4-f45a-4071-b6e5-fb8543dc4079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:12.751590 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a55f4-f45a-4071-b6e5-fb8543dc4079 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:12.752034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a55f4-f45a-4071-b6e5-fb8543dc4079 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:12.752487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a55f4-f45a-4071-b6e5-fb8543dc4079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:12.766316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a55f4-f45a-4071-b6e5-fb8543dc4079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:12.767868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a55f4-f45a-4071-b6e5-fb8543dc4079 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:12.771227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:12.774865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e39c24-1b4b-4de2-902a-cdb12d8725ed None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-da2a55f4-f45a-4071-b6e5-fb8543dc4079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:12.784692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:12.785798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:12.786677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:12.786677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:12.786677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:12.786677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 296/586] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:12.787345 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a55f4-f45a-4071-b6e5-fb8543dc4079 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:12.819437 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3125fa-9cbd-4e18-8561-7600c7bc85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:12.820084 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3125fa-9cbd-4e18-8561-7600c7bc85e4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:12.820345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3125fa-9cbd-4e18-8561-7600c7bc85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:12.820606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3125fa-9cbd-4e18-8561-7600c7bc85e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:12.828263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3125fa-9cbd-4e18-8561-7600c7bc85e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:12.829709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3125fa-9cbd-4e18-8561-7600c7bc85e4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-bf3125fa-9cbd-4e18-8561-7600c7bc85e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:12.842041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:12.843266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:12.844144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:12.844144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:12.844144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:12.844144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:12.844144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:12.844144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:12.844144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:12.844144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:12.844144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 291/587] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:12.846585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3125fa-9cbd-4e18-8561-7600c7bc85e4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:12.908799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a55f4-f45a-4071-b6e5-fb8543dc4079 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.955748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7bd2-c176-4493-9e67-c929ec2410b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:12.956365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7bd2-c176-4493-9e67-c929ec2410b0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:12.956639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7bd2-c176-4493-9e67-c929ec2410b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:12.956897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7bd2-c176-4493-9e67-c929ec2410b0 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:12.957798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7bd2-c176-4493-9e67-c929ec2410b0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:12.958091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7bd2-c176-4493-9e67-c929ec2410b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:12.959511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7bd2-c176-4493-9e67-c929ec2410b0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:12.966903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3125fa-9cbd-4e18-8561-7600c7bc85e4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:12.991679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 297/588] 10.222.0.78 () {56 vars in 1137 bytes} [Wed Aug 24 03:19:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:12.991679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7bd2-c176-4493-9e67-c929ec2410b0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.012940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:13.031773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec42b-f573-49d2-a12f-b7826dc33ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:13.032594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec42b-f573-49d2-a12f-b7826dc33ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.032967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec42b-f573-49d2-a12f-b7826dc33ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.033304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec42b-f573-49d2-a12f-b7826dc33ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.034054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ec42b-f573-49d2-a12f-b7826dc33ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:13.034427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ec42b-f573-49d2-a12f-b7826dc33ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:13.036201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ec42b-f573-49d2-a12f-b7826dc33ce0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:13.049660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 292/589] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:13.054095 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec42b-f573-49d2-a12f-b7826dc33ce0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.067377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:13.137543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7bd2-c176-4493-9e67-c929ec2410b0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:13.194270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ddf13-8bb8-4e27-a500-388b2322aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:13.195063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ddf13-8bb8-4e27-a500-388b2322aaac None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.195426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ddf13-8bb8-4e27-a500-388b2322aaac None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.195759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ddf13-8bb8-4e27-a500-388b2322aaac None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.196483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ddf13-8bb8-4e27-a500-388b2322aaac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:13.196853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ddf13-8bb8-4e27-a500-388b2322aaac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:13.198963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ddf13-8bb8-4e27-a500-388b2322aaac None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:13.212623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 298/590] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:13.213421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ddf13-8bb8-4e27-a500-388b2322aaac None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.214169 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec42b-f573-49d2-a12f-b7826dc33ce0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:13.255290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37401c9c-292b-40b9-905d-9a1185e8a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:13.255902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401c9c-292b-40b9-905d-9a1185e8a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.256184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401c9c-292b-40b9-905d-9a1185e8a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.256436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401c9c-292b-40b9-905d-9a1185e8a7a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.257137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37401c9c-292b-40b9-905d-9a1185e8a7a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:13.257436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37401c9c-292b-40b9-905d-9a1185e8a7a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:13.258906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37401c9c-292b-40b9-905d-9a1185e8a7a4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:13.271516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 293/591] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:13.272365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37401c9c-292b-40b9-905d-9a1185e8a7a4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.324129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ddf13-8bb8-4e27-a500-388b2322aaac None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:13.329450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:13.340614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:13.364157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37248da0-89cf-4500-9e52-827b33a72c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:13.364807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248da0-89cf-4500-9e52-827b33a72c4f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.365105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248da0-89cf-4500-9e52-827b33a72c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.365374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248da0-89cf-4500-9e52-827b33a72c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.376466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248da0-89cf-4500-9e52-827b33a72c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:13.377933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248da0-89cf-4500-9e52-827b33a72c4f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:13.386737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37401c9c-292b-40b9-905d-9a1185e8a7a4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-37248da0-89cf-4500-9e52-827b33a72c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:13.392921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:13.393848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:13.395059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:13.395059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:13.395059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:13.395059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 299/592] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:13.395310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37248da0-89cf-4500-9e52-827b33a72c4f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.431355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9c4c-52e6-4da7-9f74-9995f8014432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:13.432375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9c4c-52e6-4da7-9f74-9995f8014432 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.432846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9c4c-52e6-4da7-9f74-9995f8014432 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.433307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9c4c-52e6-4da7-9f74-9995f8014432 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.444858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9c4c-52e6-4da7-9f74-9995f8014432 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:13.447488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9c4c-52e6-4da7-9f74-9995f8014432 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6c4c9c4c-52e6-4da7-9f74-9995f8014432 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:13.464096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:13.465971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 294/593] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e5065-5271-45f1-93fb-f11ecbed727f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.467843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e5065-5271-45f1-93fb-f11ecbed727f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.469195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e5065-5271-45f1-93fb-f11ecbed727f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.469195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 295/594] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:13.469195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e5065-5271-45f1-93fb-f11ecbed727f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.526727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37248da0-89cf-4500-9e52-827b33a72c4f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:13.568924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862a3c3-f0c3-4e80-b690-fa6be6196c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:13.569583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862a3c3-f0c3-4e80-b690-fa6be6196c86 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.569861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862a3c3-f0c3-4e80-b690-fa6be6196c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.570134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862a3c3-f0c3-4e80-b690-fa6be6196c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.577921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862a3c3-f0c3-4e80-b690-fa6be6196c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:13.579469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862a3c3-f0c3-4e80-b690-fa6be6196c86 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0862a3c3-f0c3-4e80-b690-fa6be6196c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:13.597615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:13.598706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:13.599711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:13.599711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:13.599711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:13.599711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:13.599711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:13.599711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:13.599711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:13.599711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:13.604134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 300/595] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:13.604134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862a3c3-f0c3-4e80-b690-fa6be6196c86 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.619034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e5065-5271-45f1-93fb-f11ecbed727f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:13.627595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:13.633972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:13.666703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7abe1a-744f-4058-9612-2003cb0219e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:13.667482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7abe1a-744f-4058-9612-2003cb0219e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.667807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7abe1a-744f-4058-9612-2003cb0219e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.668128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7abe1a-744f-4058-9612-2003cb0219e3 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/d6c0b33c2c7947c59ebf8da17abbd0b6/roles/392e59acab294916b7e3713134f2a626` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.685861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7abe1a-744f-4058-9612-2003cb0219e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=d6c0b33c2c7947c59ebf8da17abbd0b6, role_id=392e59acab294916b7e3713134f2a626)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:13.687394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7abe1a-744f-4058-9612-2003cb0219e3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:13.702318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 296/596] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:19:13 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/d6c0b33c2c7947c59ebf8da17abbd0b6/roles/392e59acab294916b7e3713134f2a626 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:19:13.703234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7abe1a-744f-4058-9612-2003cb0219e3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.725066 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862a3c3-f0c3-4e80-b690-fa6be6196c86 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:13.771956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55a2c-f795-4cbe-927c-aed65b57a6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:13.772625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55a2c-f795-4cbe-927c-aed65b57a6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.772907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55a2c-f795-4cbe-927c-aed65b57a6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.773183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55a2c-f795-4cbe-927c-aed65b57a6a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.774729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55a2c-f795-4cbe-927c-aed65b57a6a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:13.775134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55a2c-f795-4cbe-927c-aed65b57a6a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:13.777162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55a2c-f795-4cbe-927c-aed65b57a6a2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:13.793673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 301/597] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:13.794819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344670e4-12ac-43c2-b327-a6363509f325 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.795107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344670e4-12ac-43c2-b327-a6363509f325 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.795384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344670e4-12ac-43c2-b327-a6363509f325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.816612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-344670e4-12ac-43c2-b327-a6363509f325 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:13.818697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-344670e4-12ac-43c2-b327-a6363509f325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:13.876649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7abe1a-744f-4058-9612-2003cb0219e3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:13.918764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 302/598] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:13.918764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344670e4-12ac-43c2-b327-a6363509f325 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.922293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932bdad-4376-43ea-a597-ecd7edc71801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:13.922959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932bdad-4376-43ea-a597-ecd7edc71801 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:13.923235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932bdad-4376-43ea-a597-ecd7edc71801 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:13.923508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932bdad-4376-43ea-a597-ecd7edc71801 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:13.924268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932bdad-4376-43ea-a597-ecd7edc71801 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:13.924572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932bdad-4376-43ea-a597-ecd7edc71801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:13.926292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932bdad-4376-43ea-a597-ecd7edc71801 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:13.961878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:13.963256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 297/599] 10.222.0.78 () {56 vars in 1139 bytes} [Wed Aug 24 03:19:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:13.963256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932bdad-4376-43ea-a597-ecd7edc71801 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:13.994893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:14.100587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344670e4-12ac-43c2-b327-a6363509f325 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:14.137495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932bdad-4376-43ea-a597-ecd7edc71801 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:14.139374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a9f6-e90f-4862-9d11-944139a6ea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:14.140074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a9f6-e90f-4862-9d11-944139a6ea30 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:14.140401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a9f6-e90f-4862-9d11-944139a6ea30 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:14.140765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a9f6-e90f-4862-9d11-944139a6ea30 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:14.141552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a9f6-e90f-4862-9d11-944139a6ea30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:14.141920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a9f6-e90f-4862-9d11-944139a6ea30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:14.143730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a9f6-e90f-4862-9d11-944139a6ea30 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:14.157982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 303/600] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:14.159073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a9f6-e90f-4862-9d11-944139a6ea30 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:14.193453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58986de8-4567-46f0-90b1-19d417e7e1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:14.194548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986de8-4567-46f0-90b1-19d417e7e1fd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:14.195002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986de8-4567-46f0-90b1-19d417e7e1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:14.195373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986de8-4567-46f0-90b1-19d417e7e1fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:14.207994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58986de8-4567-46f0-90b1-19d417e7e1fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:14.210629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58986de8-4567-46f0-90b1-19d417e7e1fd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-58986de8-4567-46f0-90b1-19d417e7e1fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:14.225987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:14.228330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 298/601] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:14.235949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58986de8-4567-46f0-90b1-19d417e7e1fd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:14.248298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:14.280737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a9f6-e90f-4862-9d11-944139a6ea30 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:14.343339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:14.344003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c1c13-8e65-4c21-bcb6-2fba77db9bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:14.344879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c1c13-8e65-4c21-bcb6-2fba77db9bcc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:14.345434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c1c13-8e65-4c21-bcb6-2fba77db9bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:14.345630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c1c13-8e65-4c21-bcb6-2fba77db9bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:14.358448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c1c13-8e65-4c21-bcb6-2fba77db9bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:14.359996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c1c13-8e65-4c21-bcb6-2fba77db9bcc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:14.376880 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58986de8-4567-46f0-90b1-19d417e7e1fd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8a4c1c13-8e65-4c21-bcb6-2fba77db9bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:14.382764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:14.383799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:14.384694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:14.384694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:14.384694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:14.385316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 304/602] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:14.386529 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c1c13-8e65-4c21-bcb6-2fba77db9bcc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:14.426270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b87f1-7dbd-467e-971e-d98312e0b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:14.427490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b87f1-7dbd-467e-971e-d98312e0b7a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:14.427966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b87f1-7dbd-467e-971e-d98312e0b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:14.428448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b87f1-7dbd-467e-971e-d98312e0b7a1 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/438786dead414066a6ef101a2493fb8c/roles/392e59acab294916b7e3713134f2a626` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:14.455032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b87f1-7dbd-467e-971e-d98312e0b7a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=438786dead414066a6ef101a2493fb8c, role_id=392e59acab294916b7e3713134f2a626)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:14.458433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b87f1-7dbd-467e-971e-d98312e0b7a1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:14.476215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 299/603] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:19:14 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/438786dead414066a6ef101a2493fb8c/roles/392e59acab294916b7e3713134f2a626 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:19:14.477457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b87f1-7dbd-467e-971e-d98312e0b7a1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:14.601456 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c1c13-8e65-4c21-bcb6-2fba77db9bcc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:14.633624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:14.645287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae8d66-0117-495c-87a0-3e88a2ce17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:14.645793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b87f1-7dbd-467e-971e-d98312e0b7a1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:14.646549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae8d66-0117-495c-87a0-3e88a2ce17dd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:14.647084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae8d66-0117-495c-87a0-3e88a2ce17dd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:14.647585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae8d66-0117-495c-87a0-3e88a2ce17dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:14.662022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae8d66-0117-495c-87a0-3e88a2ce17dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f1ae8d66-0117-495c-87a0-3e88a2ce17dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:14.668819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:14.669821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:14.670728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:14.674728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 305/604] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:14.676016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae8d66-0117-495c-87a0-3e88a2ce17dd None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:14.707893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:14.730197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd9854-8d14-483e-9c47-5c6272cf0c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:14.731268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd9854-8d14-483e-9c47-5c6272cf0c4d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:14.731743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd9854-8d14-483e-9c47-5c6272cf0c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:14.732210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd9854-8d14-483e-9c47-5c6272cf0c4d None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:14.733475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd9854-8d14-483e-9c47-5c6272cf0c4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:14.733976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd9854-8d14-483e-9c47-5c6272cf0c4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:14.736401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd9854-8d14-483e-9c47-5c6272cf0c4d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:14.757431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 300/605] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:14.758675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd9854-8d14-483e-9c47-5c6272cf0c4d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:14.818152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae8d66-0117-495c-87a0-3e88a2ce17dd None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:14.861473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df755695-f5ae-407b-a747-8efd3972f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:14.862085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df755695-f5ae-407b-a747-8efd3972f616 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:14.862421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df755695-f5ae-407b-a747-8efd3972f616 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:14.862712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df755695-f5ae-407b-a747-8efd3972f616 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:14.863669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df755695-f5ae-407b-a747-8efd3972f616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:14.863968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df755695-f5ae-407b-a747-8efd3972f616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:14.865604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df755695-f5ae-407b-a747-8efd3972f616 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:14.879933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 306/606] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:14.881022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df755695-f5ae-407b-a747-8efd3972f616 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:14.894469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd9854-8d14-483e-9c47-5c6272cf0c4d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:14.933598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08306c3-e5bd-4be5-b524-c55c245db02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:14.934610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08306c3-e5bd-4be5-b524-c55c245db02e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:14.935080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08306c3-e5bd-4be5-b524-c55c245db02e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:14.935504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08306c3-e5bd-4be5-b524-c55c245db02e None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:14.936356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08306c3-e5bd-4be5-b524-c55c245db02e None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:14.936805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08306c3-e5bd-4be5-b524-c55c245db02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:14.937453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:14.939305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08306c3-e5bd-4be5-b524-c55c245db02e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:14.951279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 301/607] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:14.952411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08306c3-e5bd-4be5-b524-c55c245db02e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:15.005907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df755695-f5ae-407b-a747-8efd3972f616 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:15.048566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d4ad8-4912-4cde-ac74-3544c0a12799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:15.049494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d4ad8-4912-4cde-ac74-3544c0a12799 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:15.049794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d4ad8-4912-4cde-ac74-3544c0a12799 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:15.050066 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d4ad8-4912-4cde-ac74-3544c0a12799 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/e736e983399140c2a7e6ee2c9e297021/roles/392e59acab294916b7e3713134f2a626` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:15.066536 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:15.069357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d4ad8-4912-4cde-ac74-3544c0a12799 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=e736e983399140c2a7e6ee2c9e297021, role_id=392e59acab294916b7e3713134f2a626)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:15.071198 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d4ad8-4912-4cde-ac74-3544c0a12799 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:15.089219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 307/608] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:19:14 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/e736e983399140c2a7e6ee2c9e297021/roles/392e59acab294916b7e3713134f2a626 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:19:15.090382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d4ad8-4912-4cde-ac74-3544c0a12799 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:15.215678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:15.219414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08306c3-e5bd-4be5-b524-c55c245db02e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:15.226307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d4ad8-4912-4cde-ac74-3544c0a12799 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:15.266541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1904f7d-6e52-434b-9e09-37da7c985544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:15.267488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1904f7d-6e52-434b-9e09-37da7c985544 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:15.267936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1904f7d-6e52-434b-9e09-37da7c985544 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:15.268357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1904f7d-6e52-434b-9e09-37da7c985544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:15.280658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1904f7d-6e52-434b-9e09-37da7c985544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:15.282545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1904f7d-6e52-434b-9e09-37da7c985544 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f1904f7d-6e52-434b-9e09-37da7c985544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:15.299667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:15.301013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:15.302455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:15.302455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:15.302455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:15.304347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 308/609] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:15.312560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1904f7d-6e52-434b-9e09-37da7c985544 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:15.329946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195536f-2691-4fed-ab7a-c1cc5deb16b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:15.331012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195536f-2691-4fed-ab7a-c1cc5deb16b9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:15.331406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195536f-2691-4fed-ab7a-c1cc5deb16b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:15.331961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195536f-2691-4fed-ab7a-c1cc5deb16b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:15.360689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195536f-2691-4fed-ab7a-c1cc5deb16b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:15.363189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195536f-2691-4fed-ab7a-c1cc5deb16b9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8195536f-2691-4fed-ab7a-c1cc5deb16b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:15.401117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:15.402239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:15.403361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:15.403361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:15.403361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:15.403361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:15.403361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:15.403361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:15.403361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:15.403361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:15.412105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 302/610] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:15.418013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195536f-2691-4fed-ab7a-c1cc5deb16b9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:15.434807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1904f7d-6e52-434b-9e09-37da7c985544 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:15.475772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0649f9-7078-4a09-9eed-30017436704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:15.476642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0649f9-7078-4a09-9eed-30017436704b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:15.477078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0649f9-7078-4a09-9eed-30017436704b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:15.477505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0649f9-7078-4a09-9eed-30017436704b None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:15.478397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0649f9-7078-4a09-9eed-30017436704b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:15.478874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0649f9-7078-4a09-9eed-30017436704b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:15.486364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0649f9-7078-4a09-9eed-30017436704b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:15.511101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 309/611] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:15.519381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0649f9-7078-4a09-9eed-30017436704b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:15.536947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:15.664009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0649f9-7078-4a09-9eed-30017436704b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:15.684492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195536f-2691-4fed-ab7a-c1cc5deb16b9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:15.701295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:15.711571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59069d-eb1d-4444-a3c2-5737405be4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:15.712614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59069d-eb1d-4444-a3c2-5737405be4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:15.713036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59069d-eb1d-4444-a3c2-5737405be4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:15.713440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59069d-eb1d-4444-a3c2-5737405be4d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:15.723682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59069d-eb1d-4444-a3c2-5737405be4d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:15.725887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59069d-eb1d-4444-a3c2-5737405be4d3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ad59069d-eb1d-4444-a3c2-5737405be4d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:15.740840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:15.741990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:15.743029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:15.750017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 310/612] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:15.753977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59069d-eb1d-4444-a3c2-5737405be4d3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:15.783059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fe8f9-4a13-4cee-9f1f-59d644da6a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:15.784087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe8f9-4a13-4cee-9f1f-59d644da6a88 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:15.784542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe8f9-4a13-4cee-9f1f-59d644da6a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:15.785390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe8f9-4a13-4cee-9f1f-59d644da6a88 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:15.786363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fe8f9-4a13-4cee-9f1f-59d644da6a88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:15.788625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fe8f9-4a13-4cee-9f1f-59d644da6a88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:15.795060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fe8f9-4a13-4cee-9f1f-59d644da6a88 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:15.842076 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 303/613] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:15.848260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51064f-e1d5-4bcd-bdb3-be699ed679a5 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:15.848539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51064f-e1d5-4bcd-bdb3-be699ed679a5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:15.848856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51064f-e1d5-4bcd-bdb3-be699ed679a5 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:15.850610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 304/614] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:15.851412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51064f-e1d5-4bcd-bdb3-be699ed679a5 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:15.937289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:15.971682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51064f-e1d5-4bcd-bdb3-be699ed679a5 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:16.005848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59069d-eb1d-4444-a3c2-5737405be4d3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:16.016333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7404-003c-4c1b-b5d1-0fa072dbec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:16.017313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7404-003c-4c1b-b5d1-0fa072dbec07 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:16.017736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7404-003c-4c1b-b5d1-0fa072dbec07 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:16.018176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7404-003c-4c1b-b5d1-0fa072dbec07 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/0e7bc56706f2491b92f5745a0fbc2acd/roles/392e59acab294916b7e3713134f2a626` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:16.036324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba7404-003c-4c1b-b5d1-0fa072dbec07 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=0e7bc56706f2491b92f5745a0fbc2acd, role_id=392e59acab294916b7e3713134f2a626)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:16.038100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba7404-003c-4c1b-b5d1-0fa072dbec07 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:16.059421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 305/615] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:19:15 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/0e7bc56706f2491b92f5745a0fbc2acd/roles/392e59acab294916b7e3713134f2a626 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:19:16.061635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53f89-d8a1-4538-acd2-ffa272eeac73 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:16.062384 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53f89-d8a1-4538-acd2-ffa272eeac73 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:16.063096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53f89-d8a1-4538-acd2-ffa272eeac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:16.085182 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdaedb-27b2-4824-b9d7-c1533b386ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:16.086235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdaedb-27b2-4824-b9d7-c1533b386ccf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:16.086785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdaedb-27b2-4824-b9d7-c1533b386ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:16.087286 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdaedb-27b2-4824-b9d7-c1533b386ccf None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:16.088732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdaedb-27b2-4824-b9d7-c1533b386ccf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:16.089319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdaedb-27b2-4824-b9d7-c1533b386ccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:16.090544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-40c53f89-d8a1-4538-acd2-ffa272eeac73 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:16.091994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-40c53f89-d8a1-4538-acd2-ffa272eeac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:16.092145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdaedb-27b2-4824-b9d7-c1533b386ccf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:16.120876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:16.138095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 311/616] 10.222.0.78 () {56 vars in 1135 bytes} [Wed Aug 24 03:19:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:16.154735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdaedb-27b2-4824-b9d7-c1533b386ccf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:16.229714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 306/617] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:16.419782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdaedb-27b2-4824-b9d7-c1533b386ccf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:16.482561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:16.501828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97b412-0bbc-459a-a775-37f46c499a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:16.503539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97b412-0bbc-459a-a775-37f46c499a8c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:16.504441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97b412-0bbc-459a-a775-37f46c499a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:16.505188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97b412-0bbc-459a-a775-37f46c499a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:16.526577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97b412-0bbc-459a-a775-37f46c499a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:16.529923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97b412-0bbc-459a-a775-37f46c499a8c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8e97b412-0bbc-459a-a775-37f46c499a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:16.564789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:16.567082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:16.568834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:16.568834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:16.568834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:16.572440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 312/618] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:16.580632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53f89-d8a1-4538-acd2-ffa272eeac73 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:16.584416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97b412-0bbc-459a-a775-37f46c499a8c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:16.750672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97b412-0bbc-459a-a775-37f46c499a8c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:16.797782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda89a3-e678-44b7-8b41-d8b541824b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:16.799450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda89a3-e678-44b7-8b41-d8b541824b4c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:16.800162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda89a3-e678-44b7-8b41-d8b541824b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:16.801085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda89a3-e678-44b7-8b41-d8b541824b4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:16.822404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda89a3-e678-44b7-8b41-d8b541824b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7dda89a3-e678-44b7-8b41-d8b541824b4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:16.836323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:16.844306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:16.849056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 313/619] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:16.858084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda89a3-e678-44b7-8b41-d8b541824b4c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:16.881744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53f89-d8a1-4538-acd2-ffa272eeac73 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:16.933872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67695f-41f7-47d5-a634-47da13a9bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:16.934496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67695f-41f7-47d5-a634-47da13a9bde3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:16.934801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67695f-41f7-47d5-a634-47da13a9bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:16.935062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67695f-41f7-47d5-a634-47da13a9bde3 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:16.935770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67695f-41f7-47d5-a634-47da13a9bde3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:16.936069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67695f-41f7-47d5-a634-47da13a9bde3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:16.937463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67695f-41f7-47d5-a634-47da13a9bde3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:16.959830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 307/620] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:16.968552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67695f-41f7-47d5-a634-47da13a9bde3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:16.987187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:16.999689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:17.127453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda89a3-e678-44b7-8b41-d8b541824b4c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:17.237404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67695f-41f7-47d5-a634-47da13a9bde3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:17.239741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18996b-d552-46a8-bac5-3e628ffd6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:17.242770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18996b-d552-46a8-bac5-3e628ffd6d72 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:17.243346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18996b-d552-46a8-bac5-3e628ffd6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:17.244034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18996b-d552-46a8-bac5-3e628ffd6d72 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:17.245209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18996b-d552-46a8-bac5-3e628ffd6d72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:17.246473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18996b-d552-46a8-bac5-3e628ffd6d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:17.248350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18996b-d552-46a8-bac5-3e628ffd6d72 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:17.267657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 314/621] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:17.279036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18996b-d552-46a8-bac5-3e628ffd6d72 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:17.312088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041b09-3908-41d4-9a89-f16b02ece38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:17.313059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041b09-3908-41d4-9a89-f16b02ece38f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:17.313481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041b09-3908-41d4-9a89-f16b02ece38f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:17.313898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041b09-3908-41d4-9a89-f16b02ece38f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:17.328964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa041b09-3908-41d4-9a89-f16b02ece38f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:17.331558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa041b09-3908-41d4-9a89-f16b02ece38f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-fa041b09-3908-41d4-9a89-f16b02ece38f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:17.368636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:17.370293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:17.371247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:17.371247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:17.371247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:17.371247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:17.371247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:17.371247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:17.371247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:17.371247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:17.371247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 308/622] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:17.380231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041b09-3908-41d4-9a89-f16b02ece38f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:17.479072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18996b-d552-46a8-bac5-3e628ffd6d72 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:17.481412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:17.501317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:17.534821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46a49-4661-40a7-bc4f-138238217977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:17.537704 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46a49-4661-40a7-bc4f-138238217977 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:17.537704 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46a49-4661-40a7-bc4f-138238217977 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:17.537704 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46a49-4661-40a7-bc4f-138238217977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:17.551687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c46a49-4661-40a7-bc4f-138238217977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:17.553740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c46a49-4661-40a7-bc4f-138238217977 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:17.562320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041b09-3908-41d4-9a89-f16b02ece38f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-70c46a49-4661-40a7-bc4f-138238217977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:17.570879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:17.571931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:17.573629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:17.573629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:17.573629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:17.578785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 315/623] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:17.580259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedc7ad-d1d2-4082-bd8f-9b3ef3584780 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:17.580551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedc7ad-d1d2-4082-bd8f-9b3ef3584780 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:17.581102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedc7ad-d1d2-4082-bd8f-9b3ef3584780 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:17.583250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 316/624] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:17.584138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedc7ad-d1d2-4082-bd8f-9b3ef3584780 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:17.632547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ad7c7-ffe4-4c20-9f19-c5adcc0c0444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:17.633938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad7c7-ffe4-4c20-9f19-c5adcc0c0444 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:17.634614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad7c7-ffe4-4c20-9f19-c5adcc0c0444 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:17.635261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad7c7-ffe4-4c20-9f19-c5adcc0c0444 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:17.636626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad7c7-ffe4-4c20-9f19-c5adcc0c0444 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:17.637459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad7c7-ffe4-4c20-9f19-c5adcc0c0444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:17.640229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ad7c7-ffe4-4c20-9f19-c5adcc0c0444 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:17.662837 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 309/625] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:17.664716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e9859-7bcd-4c2b-882f-4d614e43804c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:17.665174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e9859-7bcd-4c2b-882f-4d614e43804c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:17.665737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e9859-7bcd-4c2b-882f-4d614e43804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:17.692155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f91e9859-7bcd-4c2b-882f-4d614e43804c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:17.693773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f91e9859-7bcd-4c2b-882f-4d614e43804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:17.743854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedc7ad-d1d2-4082-bd8f-9b3ef3584780 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:17.792809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 310/626] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:17.793966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e9859-7bcd-4c2b-882f-4d614e43804c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:17.829333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3198a-89f9-4cc5-a148-214014f451af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:17.830396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3198a-89f9-4cc5-a148-214014f451af None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:17.831152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3198a-89f9-4cc5-a148-214014f451af None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:17.831354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3198a-89f9-4cc5-a148-214014f451af None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:17.832763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3198a-89f9-4cc5-a148-214014f451af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:17.833161 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3198a-89f9-4cc5-a148-214014f451af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:17.835916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3198a-89f9-4cc5-a148-214014f451af None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:17.874422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:17.880138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 317/627] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:17.889634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3198a-89f9-4cc5-a148-214014f451af None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:17.926371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:17.959276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e9859-7bcd-4c2b-882f-4d614e43804c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:18.014977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386fe13-5e45-49bb-9632-8d65cc490c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:18.016407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386fe13-5e45-49bb-9632-8d65cc490c25 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:18.016842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386fe13-5e45-49bb-9632-8d65cc490c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:18.017253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386fe13-5e45-49bb-9632-8d65cc490c25 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/c72dc03535044d6a97a953256839d413/roles/392e59acab294916b7e3713134f2a626` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:18.036147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386fe13-5e45-49bb-9632-8d65cc490c25 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=c72dc03535044d6a97a953256839d413, role_id=392e59acab294916b7e3713134f2a626)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:18.037908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386fe13-5e45-49bb-9632-8d65cc490c25 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:18.061840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 311/628] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:19:17 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/c72dc03535044d6a97a953256839d413/roles/392e59acab294916b7e3713134f2a626 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:19:18.067522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908e8d-b482-4905-9bc1-54a283546e2e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:18.070223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908e8d-b482-4905-9bc1-54a283546e2e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:18.072587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908e8d-b482-4905-9bc1-54a283546e2e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:18.077734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 312/629] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:18.084049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9052f7a-0fa4-4db5-b1c4-37574b8a31eb None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:18.084667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9052f7a-0fa4-4db5-b1c4-37574b8a31eb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:18.085083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9052f7a-0fa4-4db5-b1c4-37574b8a31eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:18.111530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a9052f7a-0fa4-4db5-b1c4-37574b8a31eb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:18.113754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a9052f7a-0fa4-4db5-b1c4-37574b8a31eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:18.146122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3198a-89f9-4cc5-a148-214014f451af None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:18.209906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 313/630] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:19:18.215747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62723c8-d1d6-4344-8a5a-d650523b5bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:18.216417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62723c8-d1d6-4344-8a5a-d650523b5bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:18.216695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62723c8-d1d6-4344-8a5a-d650523b5bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:18.216968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62723c8-d1d6-4344-8a5a-d650523b5bc3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:18.231510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62723c8-d1d6-4344-8a5a-d650523b5bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:18.233047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62723c8-d1d6-4344-8a5a-d650523b5bc3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a62723c8-d1d6-4344-8a5a-d650523b5bc3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:18.259650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:18.260894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:18.262149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 318/631] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:18.269940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9052f7a-0fa4-4db5-b1c4-37574b8a31eb None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:18.321268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:18.404826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9052f7a-0fa4-4db5-b1c4-37574b8a31eb None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:18.425451 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62723c8-d1d6-4344-8a5a-d650523b5bc3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:18.447498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54b0d-7bcb-45dd-80e4-d3d69fcdf9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:18.448774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54b0d-7bcb-45dd-80e4-d3d69fcdf9ea None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:18.449219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54b0d-7bcb-45dd-80e4-d3d69fcdf9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:18.449631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54b0d-7bcb-45dd-80e4-d3d69fcdf9ea None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:18.450557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54b0d-7bcb-45dd-80e4-d3d69fcdf9ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:18.451062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54b0d-7bcb-45dd-80e4-d3d69fcdf9ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:18.452681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54b0d-7bcb-45dd-80e4-d3d69fcdf9ea None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:18.475468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 314/632] 10.222.0.78 () {56 vars in 1137 bytes} [Wed Aug 24 03:19:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:18.487745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54b0d-7bcb-45dd-80e4-d3d69fcdf9ea None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:18.587791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:18.631125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62723c8-d1d6-4344-8a5a-d650523b5bc3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:18.673891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab988143-560d-477d-82c6-f9d1e5a13616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:18.674445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab988143-560d-477d-82c6-f9d1e5a13616 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:18.674746 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab988143-560d-477d-82c6-f9d1e5a13616 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:18.675086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab988143-560d-477d-82c6-f9d1e5a13616 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:18.688550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab988143-560d-477d-82c6-f9d1e5a13616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ab988143-560d-477d-82c6-f9d1e5a13616 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:18.694236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:18.696053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:18.698005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:18.702201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 319/633] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:18.702201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab988143-560d-477d-82c6-f9d1e5a13616 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:18.723609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:18.732935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54b0d-7bcb-45dd-80e4-d3d69fcdf9ea None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:18.774302 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d92b7-efd7-4d4a-a163-100a24e1d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:18.775009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d92b7-efd7-4d4a-a163-100a24e1d217 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:18.775290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d92b7-efd7-4d4a-a163-100a24e1d217 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:18.775601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d92b7-efd7-4d4a-a163-100a24e1d217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:18.891243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab988143-560d-477d-82c6-f9d1e5a13616 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:18.896690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d92b7-efd7-4d4a-a163-100a24e1d217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:18.900804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d92b7-efd7-4d4a-a163-100a24e1d217 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:18.930283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26217d-831c-4d31-8375-d14abd369e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:18.931299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26217d-831c-4d31-8375-d14abd369e7f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:18.931299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26217d-831c-4d31-8375-d14abd369e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:18.931569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26217d-831c-4d31-8375-d14abd369e7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:18.934019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:18.959728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26217d-831c-4d31-8375-d14abd369e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-df26217d-831c-4d31-8375-d14abd369e7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:18.968171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:18.969887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:18.971551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:18.978050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 320/634] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:18.981757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26217d-831c-4d31-8375-d14abd369e7f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:19.103881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:19.122395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 315/635] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:19.122395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d92b7-efd7-4d4a-a163-100a24e1d217 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:19.175067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26217d-831c-4d31-8375-d14abd369e7f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:19.222942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db534c-fe43-4182-99f0-acfb3a6e0e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:19.224681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db534c-fe43-4182-99f0-acfb3a6e0e6c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:19.225162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db534c-fe43-4182-99f0-acfb3a6e0e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:19.225676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db534c-fe43-4182-99f0-acfb3a6e0e6c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:19.226846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db534c-fe43-4182-99f0-acfb3a6e0e6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:19.227373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db534c-fe43-4182-99f0-acfb3a6e0e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:19.229934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db534c-fe43-4182-99f0-acfb3a6e0e6c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:19.254466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 321/636] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:19.257349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99695b-a423-42c9-9e14-294bb4d84318 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:19.257827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99695b-a423-42c9-9e14-294bb4d84318 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:19.258294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99695b-a423-42c9-9e14-294bb4d84318 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:19.262699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 322/637] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:19.262699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99695b-a423-42c9-9e14-294bb4d84318 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:19.281454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d92b7-efd7-4d4a-a163-100a24e1d217 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:19.321271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf5a9a-fae1-43f2-90ba-8a9e582c3759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:19.321881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf5a9a-fae1-43f2-90ba-8a9e582c3759 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:19.322156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf5a9a-fae1-43f2-90ba-8a9e582c3759 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:19.322419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf5a9a-fae1-43f2-90ba-8a9e582c3759 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:19.323498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf5a9a-fae1-43f2-90ba-8a9e582c3759 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:19.323797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf5a9a-fae1-43f2-90ba-8a9e582c3759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:19.325180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf5a9a-fae1-43f2-90ba-8a9e582c3759 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:19.335184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 316/638] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:19.336058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf5a9a-fae1-43f2-90ba-8a9e582c3759 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:19.371028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:19.428947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99695b-a423-42c9-9e14-294bb4d84318 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:19.450249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:19.476537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462aed53-7f52-47d5-94a2-8cb0c656fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:19.477448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aed53-7f52-47d5-94a2-8cb0c656fac3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:19.477906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aed53-7f52-47d5-94a2-8cb0c656fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:19.478357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aed53-7f52-47d5-94a2-8cb0c656fac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:19.497131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462aed53-7f52-47d5-94a2-8cb0c656fac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:19.499118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462aed53-7f52-47d5-94a2-8cb0c656fac3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-462aed53-7f52-47d5-94a2-8cb0c656fac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:19.524952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:19.525969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:19.526895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:19.526895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:19.526895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:19.527063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 323/639] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:19.528907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103642e-835b-4ff5-a97a-1c357b4f9e79 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:19.529362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103642e-835b-4ff5-a97a-1c357b4f9e79 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:19.529819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103642e-835b-4ff5-a97a-1c357b4f9e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:19.534216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf5a9a-fae1-43f2-90ba-8a9e582c3759 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:19.565921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4103642e-835b-4ff5-a97a-1c357b4f9e79 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:19.567831 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4103642e-835b-4ff5-a97a-1c357b4f9e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:19.587436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88dbd4-3cb8-4eea-a664-70540579b470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:19.588092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88dbd4-3cb8-4eea-a664-70540579b470 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:19.588363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88dbd4-3cb8-4eea-a664-70540579b470 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:19.588636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88dbd4-3cb8-4eea-a664-70540579b470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:19.615257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88dbd4-3cb8-4eea-a664-70540579b470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:19.616763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88dbd4-3cb8-4eea-a664-70540579b470 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ac88dbd4-3cb8-4eea-a664-70540579b470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:19.633813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:19.635855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:19.637671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:19.637671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:19.637671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:19.639867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 317/640] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:19.640720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88dbd4-3cb8-4eea-a664-70540579b470 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:19.698835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 324/641] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:19.699810 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103642e-835b-4ff5-a97a-1c357b4f9e79 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:19.770062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:19.789558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88dbd4-3cb8-4eea-a664-70540579b470 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:19.802986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:19.832575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473cbf-83a4-473e-988b-2f3aca40f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:19.833222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473cbf-83a4-473e-988b-2f3aca40f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:19.833500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473cbf-83a4-473e-988b-2f3aca40f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:19.833753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473cbf-83a4-473e-988b-2f3aca40f8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:19.845745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16473cbf-83a4-473e-988b-2f3aca40f8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:19.847249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16473cbf-83a4-473e-988b-2f3aca40f8c2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-16473cbf-83a4-473e-988b-2f3aca40f8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:19.864445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:19.866073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:19.867606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:19.867606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:19.867606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:19.867606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 318/642] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:19.867606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473cbf-83a4-473e-988b-2f3aca40f8c2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:19.888298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103642e-835b-4ff5-a97a-1c357b4f9e79 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:19.952630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ee732-9fda-4901-a53a-686ddbb4874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:19.954040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ee732-9fda-4901-a53a-686ddbb4874c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:19.954782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ee732-9fda-4901-a53a-686ddbb4874c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:19.955476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ee732-9fda-4901-a53a-686ddbb4874c None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:19.957004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ee732-9fda-4901-a53a-686ddbb4874c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:19.957830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ee732-9fda-4901-a53a-686ddbb4874c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:19.960621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ee732-9fda-4901-a53a-686ddbb4874c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:19.981425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 325/643] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:19.982812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ee732-9fda-4901-a53a-686ddbb4874c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:19.984319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473cbf-83a4-473e-988b-2f3aca40f8c2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:20.026085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bd61b-ed08-4c93-8f9e-8f91a4c2b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:20.026581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bd61b-ed08-4c93-8f9e-8f91a4c2b268 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.026905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bd61b-ed08-4c93-8f9e-8f91a4c2b268 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.027278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bd61b-ed08-4c93-8f9e-8f91a4c2b268 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.027821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bd61b-ed08-4c93-8f9e-8f91a4c2b268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:20.028117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bd61b-ed08-4c93-8f9e-8f91a4c2b268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:20.029605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bd61b-ed08-4c93-8f9e-8f91a4c2b268 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:20.043317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 319/644] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:20.044190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bd61b-ed08-4c93-8f9e-8f91a4c2b268 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:20.070289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:20.165535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:20.167009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bd61b-ed08-4c93-8f9e-8f91a4c2b268 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:20.172315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ee732-9fda-4901-a53a-686ddbb4874c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:20.211821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4962ba0-8a96-49a9-88a2-4062823fd019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:20.212892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4962ba0-8a96-49a9-88a2-4062823fd019 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.213341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4962ba0-8a96-49a9-88a2-4062823fd019 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.213801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4962ba0-8a96-49a9-88a2-4062823fd019 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.229184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4962ba0-8a96-49a9-88a2-4062823fd019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-a4962ba0-8a96-49a9-88a2-4062823fd019 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:20.233968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:20.239494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 320/645] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:20.240411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4962ba0-8a96-49a9-88a2-4062823fd019 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:20.243775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2886137-f45d-4663-9adf-2d5440669fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:20.244647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2886137-f45d-4663-9adf-2d5440669fde None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.245120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2886137-f45d-4663-9adf-2d5440669fde None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.245604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2886137-f45d-4663-9adf-2d5440669fde None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.246838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2886137-f45d-4663-9adf-2d5440669fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:20.247359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2886137-f45d-4663-9adf-2d5440669fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:20.249811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2886137-f45d-4663-9adf-2d5440669fde None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:20.278875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 326/646] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:20.278875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2886137-f45d-4663-9adf-2d5440669fde None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:20.384685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:20.418217 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2886137-f45d-4663-9adf-2d5440669fde None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:20.423288 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4962ba0-8a96-49a9-88a2-4062823fd019 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:20.464150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea422fdc-d883-4c06-b9f0-be100b2b86a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:20.464877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422fdc-d883-4c06-b9f0-be100b2b86a4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.465207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422fdc-d883-4c06-b9f0-be100b2b86a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.465536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422fdc-d883-4c06-b9f0-be100b2b86a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.475013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422fdc-d883-4c06-b9f0-be100b2b86a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:20.476696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422fdc-d883-4c06-b9f0-be100b2b86a4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ea422fdc-d883-4c06-b9f0-be100b2b86a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:20.491747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:20.493832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 327/647] 10.222.0.78 () {56 vars in 1093 bytes} [Wed Aug 24 03:19:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:20.495751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea422fdc-d883-4c06-b9f0-be100b2b86a4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:20.502331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9316cf-1521-4293-b301-44937603fad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:20.503247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9316cf-1521-4293-b301-44937603fad9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.503741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9316cf-1521-4293-b301-44937603fad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.504202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9316cf-1521-4293-b301-44937603fad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.516944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9316cf-1521-4293-b301-44937603fad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:20.518549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9316cf-1521-4293-b301-44937603fad9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:20.533952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-3a9316cf-1521-4293-b301-44937603fad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:20.534390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:20.535833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 321/648] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:20.537654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9316cf-1521-4293-b301-44937603fad9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:20.657384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea422fdc-d883-4c06-b9f0-be100b2b86a4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:20.682282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9316cf-1521-4293-b301-44937603fad9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:20.704896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c03415-9c01-4427-99df-3d825a2ddcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:20.705732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c03415-9c01-4427-99df-3d825a2ddcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.706132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c03415-9c01-4427-99df-3d825a2ddcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.706509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c03415-9c01-4427-99df-3d825a2ddcb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.707404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c03415-9c01-4427-99df-3d825a2ddcb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:20.707832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c03415-9c01-4427-99df-3d825a2ddcb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:20.709459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c03415-9c01-4427-99df-3d825a2ddcb6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:20.719565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 328/649] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:20.721138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e6f7-a6d7-4118-ae5d-544ee3b52cba None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.721515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e6f7-a6d7-4118-ae5d-544ee3b52cba None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.721890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e6f7-a6d7-4118-ae5d-544ee3b52cba None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.723440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 329/650] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:20.724332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807e6f7-a6d7-4118-ae5d-544ee3b52cba None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:20.739547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58e575-11b1-4d90-8268-daac7e0ccb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:20.740328 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58e575-11b1-4d90-8268-daac7e0ccb67 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.740696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58e575-11b1-4d90-8268-daac7e0ccb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.741047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58e575-11b1-4d90-8268-daac7e0ccb67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.749610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58e575-11b1-4d90-8268-daac7e0ccb67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:20.751393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58e575-11b1-4d90-8268-daac7e0ccb67 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:20.754702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-da58e575-11b1-4d90-8268-daac7e0ccb67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:20.768643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:20.771121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 322/651] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:20.773476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58e575-11b1-4d90-8268-daac7e0ccb67 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:20.857960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:20.884916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807e6f7-a6d7-4118-ae5d-544ee3b52cba None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:20.926153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f0fa2-ad90-4e3d-843c-ef2ed0d92071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:20.926795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f0fa2-ad90-4e3d-843c-ef2ed0d92071 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.927074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f0fa2-ad90-4e3d-843c-ef2ed0d92071 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.927344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f0fa2-ad90-4e3d-843c-ef2ed0d92071 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.927513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58e575-11b1-4d90-8268-daac7e0ccb67 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:20.928084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f0fa2-ad90-4e3d-843c-ef2ed0d92071 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:20.928389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f0fa2-ad90-4e3d-843c-ef2ed0d92071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:20.929860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f0fa2-ad90-4e3d-843c-ef2ed0d92071 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:20.950746 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 330/652] 10.222.0.78 () {56 vars in 1133 bytes} [Wed Aug 24 03:19:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:20.951464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f0fa2-ad90-4e3d-843c-ef2ed0d92071 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:20.976671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b8dcb-a75f-40ff-a398-d7fad4936011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:20.978085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b8dcb-a75f-40ff-a398-d7fad4936011 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:20.978531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b8dcb-a75f-40ff-a398-d7fad4936011 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:20.978990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b8dcb-a75f-40ff-a398-d7fad4936011 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:20.980148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b8dcb-a75f-40ff-a398-d7fad4936011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:20.980644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b8dcb-a75f-40ff-a398-d7fad4936011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:20.983062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b8dcb-a75f-40ff-a398-d7fad4936011 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:21.002100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 323/653] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:21.003574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d4b82-4535-410a-a739-dc176b8ffef9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:21.003984 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d4b82-4535-410a-a739-dc176b8ffef9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:21.004373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d4b82-4535-410a-a739-dc176b8ffef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:21.025879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3e8d4b82-4535-410a-a739-dc176b8ffef9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:21.027303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3e8d4b82-4535-410a-a739-dc176b8ffef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:21.084887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f0fa2-ad90-4e3d-843c-ef2ed0d92071 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:21.095955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:21.109212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 324/654] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:21.109966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d4b82-4535-410a-a739-dc176b8ffef9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:21.136009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e460b60-48f9-40a0-b5bc-e3f8f37bccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:21.136662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460b60-48f9-40a0-b5bc-e3f8f37bccf8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:21.136932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460b60-48f9-40a0-b5bc-e3f8f37bccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:21.137236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460b60-48f9-40a0-b5bc-e3f8f37bccf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:21.149708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:21.155871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e460b60-48f9-40a0-b5bc-e3f8f37bccf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:21.157463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e460b60-48f9-40a0-b5bc-e3f8f37bccf8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7e460b60-48f9-40a0-b5bc-e3f8f37bccf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:21.182744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:21.184583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:21.187229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:21.187229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:21.187229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:21.187229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 331/655] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:21.187229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e460b60-48f9-40a0-b5bc-e3f8f37bccf8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:21.314027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d4b82-4535-410a-a739-dc176b8ffef9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:21.353130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e460b60-48f9-40a0-b5bc-e3f8f37bccf8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:21.389282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52860b71-c56e-43ad-a4cc-139ef7adbf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:21.390152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52860b71-c56e-43ad-a4cc-139ef7adbf2f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:21.390561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52860b71-c56e-43ad-a4cc-139ef7adbf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:21.391027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52860b71-c56e-43ad-a4cc-139ef7adbf2f None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:21.392255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52860b71-c56e-43ad-a4cc-139ef7adbf2f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:21.392702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52860b71-c56e-43ad-a4cc-139ef7adbf2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:21.394803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52860b71-c56e-43ad-a4cc-139ef7adbf2f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:21.414681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 325/656] 10.222.0.78 () {56 vars in 1137 bytes} [Wed Aug 24 03:19:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:21.415547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52860b71-c56e-43ad-a4cc-139ef7adbf2f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:21.422367 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4553b6-df9b-4b78-937f-41ccf5750337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:21.423436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4553b6-df9b-4b78-937f-41ccf5750337 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:21.423926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4553b6-df9b-4b78-937f-41ccf5750337 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:21.424418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4553b6-df9b-4b78-937f-41ccf5750337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:21.469721 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:21.522734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:21.541967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4553b6-df9b-4b78-937f-41ccf5750337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:21.544504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4553b6-df9b-4b78-937f-41ccf5750337 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:21.549002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52860b71-c56e-43ad-a4cc-139ef7adbf2f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:21.603638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57b6ea-c178-4914-bd07-96b3990de340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:21.604397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57b6ea-c178-4914-bd07-96b3990de340 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:21.604742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57b6ea-c178-4914-bd07-96b3990de340 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:21.605067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57b6ea-c178-4914-bd07-96b3990de340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:21.606765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57b6ea-c178-4914-bd07-96b3990de340 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=d6c0b33c2c7947c59ebf8da17abbd0b6) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:21.607209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57b6ea-c178-4914-bd07-96b3990de340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:21.608791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57b6ea-c178-4914-bd07-96b3990de340 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:21.616705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 326/657] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:21 2022] GET /identity/v3/role_assignments?user.id=d6c0b33c2c7947c59ebf8da17abbd0b6&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:21.618143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57b6ea-c178-4914-bd07-96b3990de340 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:21.709947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 332/658] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:21.712461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4553b6-df9b-4b78-937f-41ccf5750337 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:21.816850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57b6ea-c178-4914-bd07-96b3990de340 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:21.836652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:21.872069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:21.879442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a7fa4-2781-4691-8bc7-86ae79602581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:21.880403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a7fa4-2781-4691-8bc7-86ae79602581 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:21.880821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a7fa4-2781-4691-8bc7-86ae79602581 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:21.881995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a7fa4-2781-4691-8bc7-86ae79602581 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:21.882194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a7fa4-2781-4691-8bc7-86ae79602581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:21.882702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a7fa4-2781-4691-8bc7-86ae79602581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:21.884856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a7fa4-2781-4691-8bc7-86ae79602581 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:21.887525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4553b6-df9b-4b78-937f-41ccf5750337 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:21.905240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 327/659] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:21.906993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a7fa4-2781-4691-8bc7-86ae79602581 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:21.954034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560fc1b-06f4-4d5f-8656-3b7474774859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:21.955107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560fc1b-06f4-4d5f-8656-3b7474774859 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:21.955694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560fc1b-06f4-4d5f-8656-3b7474774859 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:21.956088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560fc1b-06f4-4d5f-8656-3b7474774859 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:21.976502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560fc1b-06f4-4d5f-8656-3b7474774859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3560fc1b-06f4-4d5f-8656-3b7474774859 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:21.984751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:21.986638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 333/660] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:21.989684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560fc1b-06f4-4d5f-8656-3b7474774859 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:22.093460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a7fa4-2781-4691-8bc7-86ae79602581 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:22.157402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b873e-0969-454a-bbe1-c7fd09923b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:22.158440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b873e-0969-454a-bbe1-c7fd09923b8b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:22.158964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b873e-0969-454a-bbe1-c7fd09923b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:22.159428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b873e-0969-454a-bbe1-c7fd09923b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:22.172358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560fc1b-06f4-4d5f-8656-3b7474774859 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:22.220152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda9e1b-1029-4bde-b7ba-1ae491d10ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:22.221193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda9e1b-1029-4bde-b7ba-1ae491d10ccf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:22.221663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda9e1b-1029-4bde-b7ba-1ae491d10ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:22.222103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda9e1b-1029-4bde-b7ba-1ae491d10ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:22.232059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:22.245033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda9e1b-1029-4bde-b7ba-1ae491d10ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:22.248686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda9e1b-1029-4bde-b7ba-1ae491d10ccf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1cda9e1b-1029-4bde-b7ba-1ae491d10ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:22.272763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:22.274569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:22.276984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:22.276984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:22.276984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:22.277302 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b873e-0969-454a-bbe1-c7fd09923b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:22.278883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b873e-0969-454a-bbe1-c7fd09923b8b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:22.280828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 334/661] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:22.281707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda9e1b-1029-4bde-b7ba-1ae491d10ccf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:22.285124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:22.442810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 328/662] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:22.445224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b873e-0969-454a-bbe1-c7fd09923b8b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:22.463023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda9e1b-1029-4bde-b7ba-1ae491d10ccf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:22.527618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd66c9-6fcf-498b-8d34-e755dd881451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:22.528586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd66c9-6fcf-498b-8d34-e755dd881451 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:22.529067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd66c9-6fcf-498b-8d34-e755dd881451 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:22.529538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd66c9-6fcf-498b-8d34-e755dd881451 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:22.536683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:22.544481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd66c9-6fcf-498b-8d34-e755dd881451 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:22.546741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd66c9-6fcf-498b-8d34-e755dd881451 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-aafd66c9-6fcf-498b-8d34-e755dd881451 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:22.564990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:22.566056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:22.567586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 335/663] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:22.569666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd66c9-6fcf-498b-8d34-e755dd881451 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:22.593403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b873e-0969-454a-bbe1-c7fd09923b8b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:22.641277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7befc8e-9c47-40f2-8835-0b59c61562d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:22.642010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7befc8e-9c47-40f2-8835-0b59c61562d2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:22.642354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7befc8e-9c47-40f2-8835-0b59c61562d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:22.642714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7befc8e-9c47-40f2-8835-0b59c61562d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:22.643482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7befc8e-9c47-40f2-8835-0b59c61562d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:22.643855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7befc8e-9c47-40f2-8835-0b59c61562d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:22.645540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7befc8e-9c47-40f2-8835-0b59c61562d2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:22.655478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 329/664] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:22.660879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7befc8e-9c47-40f2-8835-0b59c61562d2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:22.687574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:22.758438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd66c9-6fcf-498b-8d34-e755dd881451 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:22.783549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7befc8e-9c47-40f2-8835-0b59c61562d2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:22.811431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f044f1-bd61-4f3c-850c-c50885f68a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:22.812799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f044f1-bd61-4f3c-850c-c50885f68a18 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:22.812921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f044f1-bd61-4f3c-850c-c50885f68a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:22.813439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f044f1-bd61-4f3c-850c-c50885f68a18 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:22.814577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f044f1-bd61-4f3c-850c-c50885f68a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:22.815163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f044f1-bd61-4f3c-850c-c50885f68a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:22.817692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f044f1-bd61-4f3c-850c-c50885f68a18 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:22.844662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 336/665] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:22.844662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f044f1-bd61-4f3c-850c-c50885f68a18 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:22.848886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c99a5-263b-4103-b1d5-2c25f0518997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:22.849848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c99a5-263b-4103-b1d5-2c25f0518997 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:22.850322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c99a5-263b-4103-b1d5-2c25f0518997 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:22.850792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c99a5-263b-4103-b1d5-2c25f0518997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:22.854265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:22.870561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c99a5-263b-4103-b1d5-2c25f0518997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:22.872808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c99a5-263b-4103-b1d5-2c25f0518997 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-dc3c99a5-263b-4103-b1d5-2c25f0518997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:22.896301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:22.897373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:22.898991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:22.898991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:22.898991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:22.898991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 330/666] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:22.899503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c99a5-263b-4103-b1d5-2c25f0518997 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:23.022627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f044f1-bd61-4f3c-850c-c50885f68a18 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:23.059240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:23.076811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c99a5-263b-4103-b1d5-2c25f0518997 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:23.078884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874f157-2022-4aff-b44d-91c4f6b08759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:23.079759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874f157-2022-4aff-b44d-91c4f6b08759 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:23.080116 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874f157-2022-4aff-b44d-91c4f6b08759 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:23.080521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874f157-2022-4aff-b44d-91c4f6b08759 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:23.081696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874f157-2022-4aff-b44d-91c4f6b08759 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:23.082319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874f157-2022-4aff-b44d-91c4f6b08759 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:23.084251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874f157-2022-4aff-b44d-91c4f6b08759 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:23.113304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 337/667] 10.222.0.78 () {56 vars in 1139 bytes} [Wed Aug 24 03:19:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:23.113304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874f157-2022-4aff-b44d-91c4f6b08759 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:23.145259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f0be-b976-4328-bffc-4782adfeeac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:23.145938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f0be-b976-4328-bffc-4782adfeeac0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:23.146455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f0be-b976-4328-bffc-4782adfeeac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:23.147019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f0be-b976-4328-bffc-4782adfeeac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:23.161958 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f0be-b976-4328-bffc-4782adfeeac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:23.164503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f0be-b976-4328-bffc-4782adfeeac0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4d40f0be-b976-4328-bffc-4782adfeeac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:23.188628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:23.189916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:23.191247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:23.191247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:23.191247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:23.195513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 331/668] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:23.198141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f0be-b976-4328-bffc-4782adfeeac0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:23.271679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:23.289716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874f157-2022-4aff-b44d-91c4f6b08759 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:23.332330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a196f4-2154-4bc2-9763-cbe091833858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:23.332903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a196f4-2154-4bc2-9763-cbe091833858 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:23.333145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a196f4-2154-4bc2-9763-cbe091833858 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:23.333418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a196f4-2154-4bc2-9763-cbe091833858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:23.341528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a196f4-2154-4bc2-9763-cbe091833858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:23.343038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a196f4-2154-4bc2-9763-cbe091833858 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c9a196f4-2154-4bc2-9763-cbe091833858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:23.355870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:23.357613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 338/669] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:23.359653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a196f4-2154-4bc2-9763-cbe091833858 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:23.383529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f0be-b976-4328-bffc-4782adfeeac0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:23.429369 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:23.436172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6abe-7200-4868-82ba-cab414390968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:23.437174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6abe-7200-4868-82ba-cab414390968 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:23.437550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6abe-7200-4868-82ba-cab414390968 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:23.438104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6abe-7200-4868-82ba-cab414390968 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:23.439085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6abe-7200-4868-82ba-cab414390968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:23.439409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6abe-7200-4868-82ba-cab414390968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:23.441249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6abe-7200-4868-82ba-cab414390968 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:23.459602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 332/670] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:23.461249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6abe-7200-4868-82ba-cab414390968 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:23.519144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a196f4-2154-4bc2-9763-cbe091833858 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:23.561455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e246640-b7b7-4a86-b58b-1a02392f2721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:23.562083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e246640-b7b7-4a86-b58b-1a02392f2721 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:23.562359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e246640-b7b7-4a86-b58b-1a02392f2721 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:23.562632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e246640-b7b7-4a86-b58b-1a02392f2721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:23.609382 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:23.617289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6abe-7200-4868-82ba-cab414390968 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:23.652770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e246640-b7b7-4a86-b58b-1a02392f2721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:23.654452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e246640-b7b7-4a86-b58b-1a02392f2721 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:23.662538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4e3a-5bcc-478b-bfd2-f3620cd9f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:23.663354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4e3a-5bcc-478b-bfd2-f3620cd9f976 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:23.663731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4e3a-5bcc-478b-bfd2-f3620cd9f976 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:23.664107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4e3a-5bcc-478b-bfd2-f3620cd9f976 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:23.664952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4e3a-5bcc-478b-bfd2-f3620cd9f976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:23.665312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4e3a-5bcc-478b-bfd2-f3620cd9f976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:23.666843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4e3a-5bcc-478b-bfd2-f3620cd9f976 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:23.680720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 333/671] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:23.681744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4e3a-5bcc-478b-bfd2-f3620cd9f976 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:23.710905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:23.780265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 339/672] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:23.781535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e246640-b7b7-4a86-b58b-1a02392f2721 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:23.801697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4e3a-5bcc-478b-bfd2-f3620cd9f976 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:23.841699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b17876-2ee9-4b1f-a825-3facc96f62b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:23.842317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b17876-2ee9-4b1f-a825-3facc96f62b8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:23.842593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b17876-2ee9-4b1f-a825-3facc96f62b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:23.842892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b17876-2ee9-4b1f-a825-3facc96f62b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:23.843599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b17876-2ee9-4b1f-a825-3facc96f62b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:23.844015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b17876-2ee9-4b1f-a825-3facc96f62b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:23.845511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b17876-2ee9-4b1f-a825-3facc96f62b8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:23.858998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 334/673] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:23.859946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b17876-2ee9-4b1f-a825-3facc96f62b8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:23.882123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:23.905121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e246640-b7b7-4a86-b58b-1a02392f2721 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:23.944211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a7e1-02ac-4fe4-958b-f8f3cbea78dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:23.944971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a7e1-02ac-4fe4-958b-f8f3cbea78dd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:23.945253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a7e1-02ac-4fe4-958b-f8f3cbea78dd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:23.945527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a7e1-02ac-4fe4-958b-f8f3cbea78dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:23.953625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184a7e1-02ac-4fe4-958b-f8f3cbea78dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:23.955131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184a7e1-02ac-4fe4-958b-f8f3cbea78dd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:23.958531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a184a7e1-02ac-4fe4-958b-f8f3cbea78dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:23.969801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:23.978301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 340/674] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7b06-6a72-4b33-ad45-565fb4cd52b5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:23.980335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7b06-6a72-4b33-ad45-565fb4cd52b5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:23.981544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7b06-6a72-4b33-ad45-565fb4cd52b5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:23.981544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 341/675] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:23.981544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab7b06-6a72-4b33-ad45-565fb4cd52b5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:23.986629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b17876-2ee9-4b1f-a825-3facc96f62b8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:24.046795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285d99-9267-40dc-8b90-8ab3bae30bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:24.047468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285d99-9267-40dc-8b90-8ab3bae30bdf None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:24.047747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285d99-9267-40dc-8b90-8ab3bae30bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:24.048042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285d99-9267-40dc-8b90-8ab3bae30bdf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:24.056977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84285d99-9267-40dc-8b90-8ab3bae30bdf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:24.058456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84285d99-9267-40dc-8b90-8ab3bae30bdf None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-84285d99-9267-40dc-8b90-8ab3bae30bdf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:24.071544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:24.073827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 335/676] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:24.075804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285d99-9267-40dc-8b90-8ab3bae30bdf None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:24.126857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab7b06-6a72-4b33-ad45-565fb4cd52b5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:24.164419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:24.182980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c3e9e-cc72-467c-a859-6606998185a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:24.183794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c3e9e-cc72-467c-a859-6606998185a2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:24.184157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c3e9e-cc72-467c-a859-6606998185a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:24.184560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c3e9e-cc72-467c-a859-6606998185a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:24.188717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285d99-9267-40dc-8b90-8ab3bae30bdf None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:24.196513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c3e9e-cc72-467c-a859-6606998185a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:24.198433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c3e9e-cc72-467c-a859-6606998185a2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-070c3e9e-cc72-467c-a859-6606998185a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:24.214171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:24.215921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:24.217131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:24.217131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:24.217131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:24.217131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 342/677] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:24.217131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c3e9e-cc72-467c-a859-6606998185a2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:24.231518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38a6eb-689c-4e64-bd0e-93e756f94df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:24.232151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38a6eb-689c-4e64-bd0e-93e756f94df6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:24.232423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38a6eb-689c-4e64-bd0e-93e756f94df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:24.232691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38a6eb-689c-4e64-bd0e-93e756f94df6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:24.233453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38a6eb-689c-4e64-bd0e-93e756f94df6 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=438786dead414066a6ef101a2493fb8c) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:24.233765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38a6eb-689c-4e64-bd0e-93e756f94df6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:24.235308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38a6eb-689c-4e64-bd0e-93e756f94df6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:24.243032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 336/678] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:24 2022] GET /identity/v3/role_assignments?user.id=438786dead414066a6ef101a2493fb8c&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:24.244355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d887c3e-563f-4e72-97a3-f7b36c4cc8f4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:24.244650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d887c3e-563f-4e72-97a3-f7b36c4cc8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:24.244907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d887c3e-563f-4e72-97a3-f7b36c4cc8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:24.268847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-4d887c3e-563f-4e72-97a3-f7b36c4cc8f4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:24.270687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4d887c3e-563f-4e72-97a3-f7b36c4cc8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:24.295799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:24.377428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c3e9e-cc72-467c-a859-6606998185a2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:24.382719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 337/679] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:24.382719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d887c3e-563f-4e72-97a3-f7b36c4cc8f4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:24.448009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b645cd6-b1af-40b6-9ea5-0cc52fb07465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:24.449970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b645cd6-b1af-40b6-9ea5-0cc52fb07465 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:24.449970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b645cd6-b1af-40b6-9ea5-0cc52fb07465 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:24.449970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b645cd6-b1af-40b6-9ea5-0cc52fb07465 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:24.450398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b645cd6-b1af-40b6-9ea5-0cc52fb07465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:24.450723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b645cd6-b1af-40b6-9ea5-0cc52fb07465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:24.454098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b645cd6-b1af-40b6-9ea5-0cc52fb07465 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:24.473883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 343/680] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:24.475860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b645cd6-b1af-40b6-9ea5-0cc52fb07465 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:24.497774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:24.554282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d887c3e-563f-4e72-97a3-f7b36c4cc8f4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:24.610242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbb102-233b-483e-86bf-55c474c1f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:24.611094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbb102-233b-483e-86bf-55c474c1f1cd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:24.611379 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbb102-233b-483e-86bf-55c474c1f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:24.611665 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbb102-233b-483e-86bf-55c474c1f1cd None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:24.612571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbb102-233b-483e-86bf-55c474c1f1cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:24.612966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbb102-233b-483e-86bf-55c474c1f1cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:24.615414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbb102-233b-483e-86bf-55c474c1f1cd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:24.641510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 338/681] 10.222.0.78 () {56 vars in 1135 bytes} [Wed Aug 24 03:19:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:24.642322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbb102-233b-483e-86bf-55c474c1f1cd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:24.646908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b645cd6-b1af-40b6-9ea5-0cc52fb07465 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:24.662524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:24.686547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe1942-02d5-4430-935c-1510aa67acc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:24.687187 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe1942-02d5-4430-935c-1510aa67acc7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:24.687586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe1942-02d5-4430-935c-1510aa67acc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:24.687751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe1942-02d5-4430-935c-1510aa67acc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:24.688378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe1942-02d5-4430-935c-1510aa67acc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:24.688684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe1942-02d5-4430-935c-1510aa67acc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:24.690383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe1942-02d5-4430-935c-1510aa67acc7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:24.704174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 344/682] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:24.706712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe1942-02d5-4430-935c-1510aa67acc7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:24.785810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbb102-233b-483e-86bf-55c474c1f1cd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:24.834848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:24.842974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bbc14-6c48-4045-a39e-b035e5c08c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:24.843184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe1942-02d5-4430-935c-1510aa67acc7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:24.843893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bbc14-6c48-4045-a39e-b035e5c08c79 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:24.844313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bbc14-6c48-4045-a39e-b035e5c08c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:24.844733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bbc14-6c48-4045-a39e-b035e5c08c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:24.845896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bbc14-6c48-4045-a39e-b035e5c08c79 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=e736e983399140c2a7e6ee2c9e297021) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:24.846389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bbc14-6c48-4045-a39e-b035e5c08c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:24.848803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bbc14-6c48-4045-a39e-b035e5c08c79 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:24.859796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 339/683] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:24 2022] GET /identity/v3/role_assignments?user.id=e736e983399140c2a7e6ee2c9e297021&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:24.861305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bbc14-6c48-4045-a39e-b035e5c08c79 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:24.898838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97990a4b-cf44-4ec9-8eb4-8b069126299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:24.899907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97990a4b-cf44-4ec9-8eb4-8b069126299f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:24.900498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97990a4b-cf44-4ec9-8eb4-8b069126299f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:24.900976 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97990a4b-cf44-4ec9-8eb4-8b069126299f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:24.955152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:24.998070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97990a4b-cf44-4ec9-8eb4-8b069126299f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:24.999755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97990a4b-cf44-4ec9-8eb4-8b069126299f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:25.037947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bbc14-6c48-4045-a39e-b035e5c08c79 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:25.092983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7b760-8e16-4419-811c-e643dcb521cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:25.093636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7b760-8e16-4419-811c-e643dcb521cd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:25.093903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7b760-8e16-4419-811c-e643dcb521cd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:25.094161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7b760-8e16-4419-811c-e643dcb521cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:25.115297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7b760-8e16-4419-811c-e643dcb521cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:25.116843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7b760-8e16-4419-811c-e643dcb521cd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:25.128037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 345/684] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:25.129331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97990a4b-cf44-4ec9-8eb4-8b069126299f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-c8f7b760-8e16-4419-811c-e643dcb521cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:25.140773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:25.141939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:25.142949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:25.142949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:25.142949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:25.143141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 340/685] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:25.144009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7b760-8e16-4419-811c-e643dcb521cd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:25.214182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:25.218878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:25.280065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97990a4b-cf44-4ec9-8eb4-8b069126299f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:25.289315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7b760-8e16-4419-811c-e643dcb521cd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:25.323612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482977b-1f78-4d7e-8b32-9e53306bd196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:25.324608 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482977b-1f78-4d7e-8b32-9e53306bd196 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:25.325259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482977b-1f78-4d7e-8b32-9e53306bd196 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:25.325698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482977b-1f78-4d7e-8b32-9e53306bd196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:25.334623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2587ca-de73-47f8-895b-567827c1775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:25.335433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2587ca-de73-47f8-895b-567827c1775e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:25.335805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2587ca-de73-47f8-895b-567827c1775e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:25.336161 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482977b-1f78-4d7e-8b32-9e53306bd196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:25.336287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2587ca-de73-47f8-895b-567827c1775e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:25.337879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482977b-1f78-4d7e-8b32-9e53306bd196 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:25.350568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2587ca-de73-47f8-895b-567827c1775e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:25.352279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2587ca-de73-47f8-895b-567827c1775e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b482977b-1f78-4d7e-8b32-9e53306bd196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:25.353864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:25.354927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:25.356046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:25.356046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:25.356046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:25.356046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:25.356046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:25.356046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:25.356046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:25.356046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:25.359056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 346/686] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:25.360148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482977b-1f78-4d7e-8b32-9e53306bd196 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-fc2587ca-de73-47f8-895b-567827c1775e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:25.374608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:25.375961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:25.377091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:25.377091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:25.377091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:25.378496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 341/687] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:25.379627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2587ca-de73-47f8-895b-567827c1775e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:25.492470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482977b-1f78-4d7e-8b32-9e53306bd196 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:25.514109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:25.521169 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2587ca-de73-47f8-895b-567827c1775e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:25.529129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:25.536958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab102c-5083-483b-9ac7-8e88741c7891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:25.537968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab102c-5083-483b-9ac7-8e88741c7891 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:25.538473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab102c-5083-483b-9ac7-8e88741c7891 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:25.538988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab102c-5083-483b-9ac7-8e88741c7891 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:25.539878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab102c-5083-483b-9ac7-8e88741c7891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:25.540522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab102c-5083-483b-9ac7-8e88741c7891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:25.542233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab102c-5083-483b-9ac7-8e88741c7891 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:25.560768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c3746-52b8-4bd9-aa4a-c5aad757bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:25.560768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3746-52b8-4bd9-aa4a-c5aad757bd53 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:25.560768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3746-52b8-4bd9-aa4a-c5aad757bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:25.560768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3746-52b8-4bd9-aa4a-c5aad757bd53 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:25.561193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c3746-52b8-4bd9-aa4a-c5aad757bd53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:25.561274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c3746-52b8-4bd9-aa4a-c5aad757bd53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:25.561841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 347/688] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:25.562779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c3746-52b8-4bd9-aa4a-c5aad757bd53 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:25.563249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab102c-5083-483b-9ac7-8e88741c7891 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:25.577851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 342/689] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:25.579003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c3746-52b8-4bd9-aa4a-c5aad757bd53 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:25.687452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab102c-5083-483b-9ac7-8e88741c7891 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:25.691975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c3746-52b8-4bd9-aa4a-c5aad757bd53 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:25.727535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487f9d-d577-428e-a261-40dd569de936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:25.728264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487f9d-d577-428e-a261-40dd569de936 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:25.728607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487f9d-d577-428e-a261-40dd569de936 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:25.728892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca591d18-1236-478b-8880-db8352f26095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:25.729018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487f9d-d577-428e-a261-40dd569de936 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:25.729661 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487f9d-d577-428e-a261-40dd569de936 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:25.729992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca591d18-1236-478b-8880-db8352f26095 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:25.730436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca591d18-1236-478b-8880-db8352f26095 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:25.730895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca591d18-1236-478b-8880-db8352f26095 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:25.731425 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487f9d-d577-428e-a261-40dd569de936 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:25.731926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca591d18-1236-478b-8880-db8352f26095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:25.732436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca591d18-1236-478b-8880-db8352f26095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:25.733990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca591d18-1236-478b-8880-db8352f26095 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:25.748325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 348/690] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:25.749516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca591d18-1236-478b-8880-db8352f26095 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:25.766683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 343/691] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:19:25 2022] POST /identity/v3/users => generated 254 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:19:25.766683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487f9d-d577-428e-a261-40dd569de936 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:25.780065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:25.884673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:25.895668 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487f9d-d577-428e-a261-40dd569de936 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:25.939551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e8561-d0ff-497f-9902-b057ca8ccceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:25.940309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e8561-d0ff-497f-9902-b057ca8ccceb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:25.940642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e8561-d0ff-497f-9902-b057ca8ccceb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:25.941014 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e8561-d0ff-497f-9902-b057ca8ccceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:25.950086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e8561-d0ff-497f-9902-b057ca8ccceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:25.951734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e8561-d0ff-497f-9902-b057ca8ccceb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-145e8561-d0ff-497f-9902-b057ca8ccceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:25.966260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:25.967259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:25.968219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:25.968219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:25.968219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:25.968219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:25.968219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:25.968219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:25.968219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:25.968219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:25.968219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 344/692] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:25.973619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e8561-d0ff-497f-9902-b057ca8ccceb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:26.001171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca591d18-1236-478b-8880-db8352f26095 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:26.049905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1a157-5869-43db-86c8-1662871e18ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:26.051783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1a157-5869-43db-86c8-1662871e18ee None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:26.052272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1a157-5869-43db-86c8-1662871e18ee None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:26.052773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1a157-5869-43db-86c8-1662871e18ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:26.053805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1a157-5869-43db-86c8-1662871e18ee None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=0e7bc56706f2491b92f5745a0fbc2acd) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:26.054309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1a157-5869-43db-86c8-1662871e18ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:26.056560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1a157-5869-43db-86c8-1662871e18ee None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:26.064108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 349/693] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:25 2022] GET /identity/v3/role_assignments?user.id=0e7bc56706f2491b92f5745a0fbc2acd&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:26.077736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:26.111775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e8561-d0ff-497f-9902-b057ca8ccceb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:26.153260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406abf1-7ac2-482c-9355-ea7eed2e69ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:26.153895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406abf1-7ac2-482c-9355-ea7eed2e69ab None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:26.154170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406abf1-7ac2-482c-9355-ea7eed2e69ab None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:26.154440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406abf1-7ac2-482c-9355-ea7eed2e69ab None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:26.155214 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406abf1-7ac2-482c-9355-ea7eed2e69ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:26.155522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406abf1-7ac2-482c-9355-ea7eed2e69ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:26.157028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406abf1-7ac2-482c-9355-ea7eed2e69ab None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:26.172094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 345/694] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:26.178151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1a157-5869-43db-86c8-1662871e18ee None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:26.296540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1a157-5869-43db-86c8-1662871e18ee None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:26.316018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:26.337581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c7bd5-2bae-4c6c-9e5e-869a1bcf2971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:26.338204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c7bd5-2bae-4c6c-9e5e-869a1bcf2971 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:26.338479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c7bd5-2bae-4c6c-9e5e-869a1bcf2971 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:26.338799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c7bd5-2bae-4c6c-9e5e-869a1bcf2971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:26.339535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c7bd5-2bae-4c6c-9e5e-869a1bcf2971 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=c72dc03535044d6a97a953256839d413) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:26.339838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c7bd5-2bae-4c6c-9e5e-869a1bcf2971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:26.341291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c7bd5-2bae-4c6c-9e5e-869a1bcf2971 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:26.348864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 350/695] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:26 2022] GET /identity/v3/role_assignments?user.id=c72dc03535044d6a97a953256839d413&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:26.530340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347edb-0008-4934-9d08-93dd8e0dd049 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:26.530899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347edb-0008-4934-9d08-93dd8e0dd049 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:26.530899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac347edb-0008-4934-9d08-93dd8e0dd049 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:26.532567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 346/696] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:26.548120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b843c1-b5dd-4a17-afa3-66dbd4d544e1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:26.548329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b843c1-b5dd-4a17-afa3-66dbd4d544e1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:26.548579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b843c1-b5dd-4a17-afa3-66dbd4d544e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:26.575644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-20b843c1-b5dd-4a17-afa3-66dbd4d544e1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:26.576898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-20b843c1-b5dd-4a17-afa3-66dbd4d544e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:26.674007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 351/697] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:27.093528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac347edb-0008-4934-9d08-93dd8e0dd049 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:27.171940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540947c-89c2-4878-838e-6251c079a2c0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:27.172483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540947c-89c2-4878-838e-6251c079a2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:27.172483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540947c-89c2-4878-838e-6251c079a2c0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:27.176453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 352/698] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:27.183175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c8702-3577-4160-9d9a-13d14864098b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:27.183795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c8702-3577-4160-9d9a-13d14864098b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:27.184477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c8702-3577-4160-9d9a-13d14864098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:27.207941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ca2c8702-3577-4160-9d9a-13d14864098b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:27.209743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ca2c8702-3577-4160-9d9a-13d14864098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:27.255724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac347edb-0008-4934-9d08-93dd8e0dd049 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:27.358076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 353/699] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:27.360222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c15d1f-89f8-443b-9c46-e7ec8aa33b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:27.361012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15d1f-89f8-443b-9c46-e7ec8aa33b67 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:27.361412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15d1f-89f8-443b-9c46-e7ec8aa33b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:27.361681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15d1f-89f8-443b-9c46-e7ec8aa33b67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:27.365553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:27.376570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c15d1f-89f8-443b-9c46-e7ec8aa33b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-68c15d1f-89f8-443b-9c46-e7ec8aa33b67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:27.382140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:27.383150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:27.383960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 347/700] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:27.390018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c8702-3577-4160-9d9a-13d14864098b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:27.448548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:27.517548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c8702-3577-4160-9d9a-13d14864098b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:27.582864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2267c-a93f-4fd7-885a-c0efdb6b165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:27.583530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2267c-a93f-4fd7-885a-c0efdb6b165c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:27.583809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2267c-a93f-4fd7-885a-c0efdb6b165c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:27.584182 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2267c-a93f-4fd7-885a-c0efdb6b165c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:27.585243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2267c-a93f-4fd7-885a-c0efdb6b165c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:27.585551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2267c-a93f-4fd7-885a-c0efdb6b165c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:27.587126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2267c-a93f-4fd7-885a-c0efdb6b165c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:27.603246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 354/701] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:27.611950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c15d1f-89f8-443b-9c46-e7ec8aa33b67 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:27.781438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c15d1f-89f8-443b-9c46-e7ec8aa33b67 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:27.805846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2267c-a93f-4fd7-885a-c0efdb6b165c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:27.841653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c47d4-027f-4f85-bb94-11ac73a74ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:27.842336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c47d4-027f-4f85-bb94-11ac73a74ffa None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:27.842611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c47d4-027f-4f85-bb94-11ac73a74ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:27.842909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c47d4-027f-4f85-bb94-11ac73a74ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:27.866962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c47d4-027f-4f85-bb94-11ac73a74ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:27.868363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c47d4-027f-4f85-bb94-11ac73a74ffa None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6f4c47d4-027f-4f85-bb94-11ac73a74ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:27.898606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:27.900482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:27.902175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:27.902175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:27.902175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:27.905802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 348/702] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:27.916412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c47d4-027f-4f85-bb94-11ac73a74ffa None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:28.021315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2267c-a93f-4fd7-885a-c0efdb6b165c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:28.023518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:28.024059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:28.076702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c47d4-027f-4f85-bb94-11ac73a74ffa None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:28.095868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af687-4ecc-491a-85c1-fec79240747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:28.096535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af687-4ecc-491a-85c1-fec79240747d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.096812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af687-4ecc-491a-85c1-fec79240747d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.097113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af687-4ecc-491a-85c1-fec79240747d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.098359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af687-4ecc-491a-85c1-fec79240747d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:28.099673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af687-4ecc-491a-85c1-fec79240747d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:28.114145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da9949-19c5-4748-b945-b8ef55f0fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:28.114546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da9949-19c5-4748-b945-b8ef55f0fec4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.114905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da9949-19c5-4748-b945-b8ef55f0fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.115055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da9949-19c5-4748-b945-b8ef55f0fec4 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.115772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da9949-19c5-4748-b945-b8ef55f0fec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:28.116074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da9949-19c5-4748-b945-b8ef55f0fec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:28.117530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da9949-19c5-4748-b945-b8ef55f0fec4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-300af687-4ecc-491a-85c1-fec79240747d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:28.126567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:28.128527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:28.133405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 355/703] 10.222.0.78 () {56 vars in 1129 bytes} [Wed Aug 24 03:19:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:28.140648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 349/704] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:28.140902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af687-4ecc-491a-85c1-fec79240747d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:28.141136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da9949-19c5-4748-b945-b8ef55f0fec4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:28.250362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da9949-19c5-4748-b945-b8ef55f0fec4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:28.258928 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:28.288868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d03d95-e81c-4d68-be2d-90c226db8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:28.289513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d03d95-e81c-4d68-be2d-90c226db8fff None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.289786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d03d95-e81c-4d68-be2d-90c226db8fff None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.290121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d03d95-e81c-4d68-be2d-90c226db8fff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.298286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d03d95-e81c-4d68-be2d-90c226db8fff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:28.299894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d03d95-e81c-4d68-be2d-90c226db8fff None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-42d03d95-e81c-4d68-be2d-90c226db8fff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:28.312881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:28.317162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 350/705] 10.222.0.78 () {56 vars in 1093 bytes} [Wed Aug 24 03:19:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:28.320713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d03d95-e81c-4d68-be2d-90c226db8fff None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:28.339027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af687-4ecc-491a-85c1-fec79240747d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:28.423929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74ff44-c746-48e7-9d41-96050c03cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:28.425465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74ff44-c746-48e7-9d41-96050c03cde0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.426866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d03d95-e81c-4d68-be2d-90c226db8fff None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:28.427538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74ff44-c746-48e7-9d41-96050c03cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.428313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74ff44-c746-48e7-9d41-96050c03cde0 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.429832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74ff44-c746-48e7-9d41-96050c03cde0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:28.430630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74ff44-c746-48e7-9d41-96050c03cde0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:28.438776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74ff44-c746-48e7-9d41-96050c03cde0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:28.451846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 356/706] 10.222.0.78 () {56 vars in 1124 bytes} [Wed Aug 24 03:19:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:28.457275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74ff44-c746-48e7-9d41-96050c03cde0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:28.464367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45201a-b450-4796-9c13-aad0cc343f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:28.464988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45201a-b450-4796-9c13-aad0cc343f6c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.465263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45201a-b450-4796-9c13-aad0cc343f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.465538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45201a-b450-4796-9c13-aad0cc343f6c None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.470685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45201a-b450-4796-9c13-aad0cc343f6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:28.470685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45201a-b450-4796-9c13-aad0cc343f6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:28.470685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45201a-b450-4796-9c13-aad0cc343f6c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:28.488633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 351/707] 10.222.0.78 () {56 vars in 1133 bytes} [Wed Aug 24 03:19:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:28.494264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45201a-b450-4796-9c13-aad0cc343f6c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:28.519883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:28.523288 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:28.611696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45201a-b450-4796-9c13-aad0cc343f6c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:28.650940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffeed2-2036-4970-94e9-23a4199bf410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:28.652569 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffeed2-2036-4970-94e9-23a4199bf410 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.653007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffeed2-2036-4970-94e9-23a4199bf410 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.653617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffeed2-2036-4970-94e9-23a4199bf410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.666844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74ff44-c746-48e7-9d41-96050c03cde0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:28.724616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdb982-053f-4e64-a81f-6c0296d91750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:28.725237 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdb982-053f-4e64-a81f-6c0296d91750 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.725511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdb982-053f-4e64-a81f-6c0296d91750 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.725775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdb982-053f-4e64-a81f-6c0296d91750 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.726410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdb982-053f-4e64-a81f-6c0296d91750 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:28.726732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdb982-053f-4e64-a81f-6c0296d91750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:28.728365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdb982-053f-4e64-a81f-6c0296d91750 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:28.735168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 357/708] 10.222.0.78 () {56 vars in 1124 bytes} [Wed Aug 24 03:19:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:28.736037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffeed2-2036-4970-94e9-23a4199bf410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:28.736478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4c2a-c365-44ca-b8e5-b3f6f56ebb1a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.736760 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4c2a-c365-44ca-b8e5-b3f6f56ebb1a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.737021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4c2a-c365-44ca-b8e5-b3f6f56ebb1a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.738292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffeed2-2036-4970-94e9-23a4199bf410 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:28.738791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 358/709] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:28.744530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e328-7dbf-4648-8077-21291d1ee7de None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.744951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e328-7dbf-4648-8077-21291d1ee7de None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.745334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e328-7dbf-4648-8077-21291d1ee7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.767384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3bd7e328-7dbf-4648-8077-21291d1ee7de None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:28.769009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3bd7e328-7dbf-4648-8077-21291d1ee7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:28.770281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:28.864859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 352/710] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:28.871889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffeed2-2036-4970-94e9-23a4199bf410 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:28.877905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 359/711] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:28.969512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef8308-6e9e-44c9-99fe-87893c0415e7 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.969875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef8308-6e9e-44c9-99fe-87893c0415e7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.970038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef8308-6e9e-44c9-99fe-87893c0415e7 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:28.971788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 360/712] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:28.988462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc948-148a-4ade-96dc-038f38aa6efc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:28.988719 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc948-148a-4ade-96dc-038f38aa6efc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:28.989002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc948-148a-4ade-96dc-038f38aa6efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.009819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffeed2-2036-4970-94e9-23a4199bf410 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:29.017687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fd5dc948-148a-4ade-96dc-038f38aa6efc None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:29.020205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fd5dc948-148a-4ade-96dc-038f38aa6efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:29.039909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:29.048018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:29.054806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d996a7-5995-47fb-8a06-f78647ca69a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:29.055458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d996a7-5995-47fb-8a06-f78647ca69a2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.055728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d996a7-5995-47fb-8a06-f78647ca69a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.055992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d996a7-5995-47fb-8a06-f78647ca69a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.079095 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d996a7-5995-47fb-8a06-f78647ca69a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:29.080662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d996a7-5995-47fb-8a06-f78647ca69a2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-46d996a7-5995-47fb-8a06-f78647ca69a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:29.108201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:29.109258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:29.110202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:29.110202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:29.110202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:29.116643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 353/713] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:29.117738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d996a7-5995-47fb-8a06-f78647ca69a2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:29.119203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 361/714] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:29.179990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc948-148a-4ade-96dc-038f38aa6efc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:29.269929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d996a7-5995-47fb-8a06-f78647ca69a2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:29.308954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc948-148a-4ade-96dc-038f38aa6efc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:29.309354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c182af-0b29-410d-954d-5b996e3727f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:29.309902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c182af-0b29-410d-954d-5b996e3727f7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.310179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c182af-0b29-410d-954d-5b996e3727f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.310495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c182af-0b29-410d-954d-5b996e3727f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.311203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c182af-0b29-410d-954d-5b996e3727f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:29.311513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c182af-0b29-410d-954d-5b996e3727f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:29.313755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c182af-0b29-410d-954d-5b996e3727f7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:29.327699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 354/715] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:29.332396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d263089-caf2-415a-839d-59c49ce41137 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.332396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d263089-caf2-415a-839d-59c49ce41137 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.332396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d263089-caf2-415a-839d-59c49ce41137 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.332396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 355/716] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:29.336225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d263089-caf2-415a-839d-59c49ce41137 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:29.361234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7966ef-8311-4e63-882f-a855fd09e247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:29.363074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7966ef-8311-4e63-882f-a855fd09e247 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.363563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7966ef-8311-4e63-882f-a855fd09e247 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.364298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7966ef-8311-4e63-882f-a855fd09e247 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.377341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:29.381783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7966ef-8311-4e63-882f-a855fd09e247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-bb7966ef-8311-4e63-882f-a855fd09e247 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:29.389491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:29.390518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:29.391433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:29.393818 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 362/717] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:29.393818 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c5a54-f092-4f4d-99c3-6cd4e9958cf5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.394049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c5a54-f092-4f4d-99c3-6cd4e9958cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.394300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c5a54-f092-4f4d-99c3-6cd4e9958cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.414464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4b6c5a54-f092-4f4d-99c3-6cd4e9958cf5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:29.415720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4b6c5a54-f092-4f4d-99c3-6cd4e9958cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:29.426799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:29.463391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d263089-caf2-415a-839d-59c49ce41137 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:29.495848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 363/718] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:29.496830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c5a54-f092-4f4d-99c3-6cd4e9958cf5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:29.521957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0f716-4f57-43ed-93e1-eccc7f2d21e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:29.523224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f716-4f57-43ed-93e1-eccc7f2d21e6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.523682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f716-4f57-43ed-93e1-eccc7f2d21e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.524130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f716-4f57-43ed-93e1-eccc7f2d21e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.534793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0f716-4f57-43ed-93e1-eccc7f2d21e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:29.537477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0f716-4f57-43ed-93e1-eccc7f2d21e6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8ab0f716-4f57-43ed-93e1-eccc7f2d21e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:29.551133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:29.552130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:29.552991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:29.552991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:29.552991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:29.552991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:29.552991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:29.552991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:29.552991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:29.552991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:29.557375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 356/719] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:29.558382 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0f716-4f57-43ed-93e1-eccc7f2d21e6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:29.632263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c5a54-f092-4f4d-99c3-6cd4e9958cf5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:29.672061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d4d24-7335-4814-86f0-ad987722c650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:29.672779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d4d24-7335-4814-86f0-ad987722c650 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.673115 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d4d24-7335-4814-86f0-ad987722c650 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.673442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d4d24-7335-4814-86f0-ad987722c650 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.674172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d4d24-7335-4814-86f0-ad987722c650 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:29.674766 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d4d24-7335-4814-86f0-ad987722c650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:29.676130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d4d24-7335-4814-86f0-ad987722c650 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:29.685295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:29.685933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 364/720] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:29.687002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d4d24-7335-4814-86f0-ad987722c650 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:29.694314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0f716-4f57-43ed-93e1-eccc7f2d21e6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:29.696708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:29.737363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145ae07-e0de-4b30-b7e5-754768a2a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:29.738555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145ae07-e0de-4b30-b7e5-754768a2a47a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.739038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145ae07-e0de-4b30-b7e5-754768a2a47a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.739803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145ae07-e0de-4b30-b7e5-754768a2a47a None admin] PATH_INFO: `/v3/services/network` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.741107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145ae07-e0de-4b30-b7e5-754768a2a47a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:29.743369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145ae07-e0de-4b30-b7e5-754768a2a47a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-d145ae07-e0de-4b30-b7e5-754768a2a47a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:29.755376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:29.756414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:19:29.757240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:29.760064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 357/721] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:29 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:29.761133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145ae07-e0de-4b30-b7e5-754768a2a47a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:29.797462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d4d24-7335-4814-86f0-ad987722c650 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:29.836903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d1bd-1580-4c09-aa9b-1728a1305bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:29.837521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d1bd-1580-4c09-aa9b-1728a1305bad None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.837797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d1bd-1580-4c09-aa9b-1728a1305bad None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.838068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d1bd-1580-4c09-aa9b-1728a1305bad None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.838796 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d1bd-1580-4c09-aa9b-1728a1305bad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:29.839101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d1bd-1580-4c09-aa9b-1728a1305bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:29.840640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d1bd-1580-4c09-aa9b-1728a1305bad None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:29.853544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 365/722] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:29.854401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d1bd-1580-4c09-aa9b-1728a1305bad None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:29.885641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145ae07-e0de-4b30-b7e5-754768a2a47a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:29.927748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7bcb5-2512-4950-b237-142c0076993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:29.928389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7bcb5-2512-4950-b237-142c0076993c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:29.928661 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7bcb5-2512-4950-b237-142c0076993c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:29.928938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7bcb5-2512-4950-b237-142c0076993c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:29.937433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:29.941748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7bcb5-2512-4950-b237-142c0076993c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:29.942873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7bcb5-2512-4950-b237-142c0076993c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-62d7bcb5-2512-4950-b237-142c0076993c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:29.964751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:29.965766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:29.966708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:29.966708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:29.966708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:29.966708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 358/723] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:29.966708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7bcb5-2512-4950-b237-142c0076993c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:29.984001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:29.996747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d1bd-1580-4c09-aa9b-1728a1305bad None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:30.039373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41813-81b0-414f-9be6-1fe351836303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:30.039970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41813-81b0-414f-9be6-1fe351836303 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.040254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41813-81b0-414f-9be6-1fe351836303 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.040524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41813-81b0-414f-9be6-1fe351836303 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.041196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41813-81b0-414f-9be6-1fe351836303 None admin] RBAC: Adding query filter params (name=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:30.041510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41813-81b0-414f-9be6-1fe351836303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:30.043107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41813-81b0-414f-9be6-1fe351836303 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:30.048751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 366/724] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:19:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:30.051931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41813-81b0-414f-9be6-1fe351836303 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:30.095560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7bcb5-2512-4950-b237-142c0076993c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:30.137169 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7338d-014e-42dd-9041-6d3d0fa3bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:30.137805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7338d-014e-42dd-9041-6d3d0fa3bc57 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.138087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7338d-014e-42dd-9041-6d3d0fa3bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.138359 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7338d-014e-42dd-9041-6d3d0fa3bc57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.150643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7338d-014e-42dd-9041-6d3d0fa3bc57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-afb7338d-014e-42dd-9041-6d3d0fa3bc57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:30.157007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:30.157913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 359/725] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:30.159152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7338d-014e-42dd-9041-6d3d0fa3bc57 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:30.183003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41813-81b0-414f-9be6-1fe351836303 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:30.212901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:30.220085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e477f8-ed04-46d7-9104-d30287f0c44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:30.220704 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e477f8-ed04-46d7-9104-d30287f0c44f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.220979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e477f8-ed04-46d7-9104-d30287f0c44f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.221246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e477f8-ed04-46d7-9104-d30287f0c44f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.221975 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e477f8-ed04-46d7-9104-d30287f0c44f None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=438786dead414066a6ef101a2493fb8c) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:30.222450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e477f8-ed04-46d7-9104-d30287f0c44f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:30.224538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e477f8-ed04-46d7-9104-d30287f0c44f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:30.231416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 367/726] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:30 2022] GET /identity/v3/role_assignments?user.id=438786dead414066a6ef101a2493fb8c&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:30.232958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e477f8-ed04-46d7-9104-d30287f0c44f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:30.249140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:30.292342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7338d-014e-42dd-9041-6d3d0fa3bc57 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:30.339607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa50702-90da-4689-aed6-e7caa56b7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:30.340708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa50702-90da-4689-aed6-e7caa56b7e87 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.341535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa50702-90da-4689-aed6-e7caa56b7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.341953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa50702-90da-4689-aed6-e7caa56b7e87 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.343071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa50702-90da-4689-aed6-e7caa56b7e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:30.343582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa50702-90da-4689-aed6-e7caa56b7e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:30.345143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa50702-90da-4689-aed6-e7caa56b7e87 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:30.371444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 360/727] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:30.373105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa50702-90da-4689-aed6-e7caa56b7e87 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:30.390040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e477f8-ed04-46d7-9104-d30287f0c44f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:30.444334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18426112-8be0-4148-9184-653e8bf4c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:30.444980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18426112-8be0-4148-9184-653e8bf4c096 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.445256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18426112-8be0-4148-9184-653e8bf4c096 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.445527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18426112-8be0-4148-9184-653e8bf4c096 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.446184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18426112-8be0-4148-9184-653e8bf4c096 None admin] RBAC: Adding query filter params (type=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:30.446492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18426112-8be0-4148-9184-653e8bf4c096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:30.448306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18426112-8be0-4148-9184-653e8bf4c096 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:30.455695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 368/728] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:19:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:30.457421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18426112-8be0-4148-9184-653e8bf4c096 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:30.535217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa50702-90da-4689-aed6-e7caa56b7e87 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:30.553304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:30.580538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:30.595599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9428c-3f45-4374-a229-3b224aaec446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:30.596720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9428c-3f45-4374-a229-3b224aaec446 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.597462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9428c-3f45-4374-a229-3b224aaec446 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.597970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9428c-3f45-4374-a229-3b224aaec446 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.598898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9428c-3f45-4374-a229-3b224aaec446 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:30.599427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9428c-3f45-4374-a229-3b224aaec446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:30.601423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9428c-3f45-4374-a229-3b224aaec446 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:30.616995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 361/729] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:30.617282 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18426112-8be0-4148-9184-653e8bf4c096 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:30.623667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9428c-3f45-4374-a229-3b224aaec446 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:30.681896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000baa3-ba1a-4396-add1-2dbeeb80a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:30.682563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000baa3-ba1a-4396-add1-2dbeeb80a97f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.683092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000baa3-ba1a-4396-add1-2dbeeb80a97f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.683197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000baa3-ba1a-4396-add1-2dbeeb80a97f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.692884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000baa3-ba1a-4396-add1-2dbeeb80a97f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:30.694351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000baa3-ba1a-4396-add1-2dbeeb80a97f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8000baa3-ba1a-4396-add1-2dbeeb80a97f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:30.708069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:30.709085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:30.710004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 369/730] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:19:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:30.715158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000baa3-ba1a-4396-add1-2dbeeb80a97f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:30.817463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9428c-3f45-4374-a229-3b224aaec446 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:30.839013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000baa3-ba1a-4396-add1-2dbeeb80a97f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:30.881406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:30.897059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3166c-6388-4e68-af67-52c2e68eb3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:30.897691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3166c-6388-4e68-af67-52c2e68eb3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.897969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3166c-6388-4e68-af67-52c2e68eb3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.898279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3166c-6388-4e68-af67-52c2e68eb3f7 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.899146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3166c-6388-4e68-af67-52c2e68eb3f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:30.899507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3166c-6388-4e68-af67-52c2e68eb3f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:30.901093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3166c-6388-4e68-af67-52c2e68eb3f7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:30.907434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03493602-aea2-4c16-9c53-5b77b72468fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:30.908097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493602-aea2-4c16-9c53-5b77b72468fa None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.908372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493602-aea2-4c16-9c53-5b77b72468fa None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.908637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493602-aea2-4c16-9c53-5b77b72468fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.922521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 370/731] 10.222.0.78 () {56 vars in 1149 bytes} [Wed Aug 24 03:19:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:30.929164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3166c-6388-4e68-af67-52c2e68eb3f7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:30.931486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03493602-aea2-4c16-9c53-5b77b72468fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:30.933128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03493602-aea2-4c16-9c53-5b77b72468fa None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-03493602-aea2-4c16-9c53-5b77b72468fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:30.955954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:30.957409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:30.958440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:30.958440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:30.958440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:30.962699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 362/732] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:30.962699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105b19-4ea6-4cfb-9d98-5258fb72a132 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:30.962699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105b19-4ea6-4cfb-9d98-5258fb72a132 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:30.962699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105b19-4ea6-4cfb-9d98-5258fb72a132 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:30.967597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 363/733] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:30.968591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105b19-4ea6-4cfb-9d98-5258fb72a132 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:31.035357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:31.047570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3166c-6388-4e68-af67-52c2e68eb3f7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:31.086723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545db0e-16ca-4f6f-ba2f-483b2c7e03e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:31.087355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545db0e-16ca-4f6f-ba2f-483b2c7e03e7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:31.087635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545db0e-16ca-4f6f-ba2f-483b2c7e03e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:31.087905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545db0e-16ca-4f6f-ba2f-483b2c7e03e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:31.123502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105b19-4ea6-4cfb-9d98-5258fb72a132 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:31.145152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:31.180815 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938bfaa-b2d7-4eba-a6d4-06a6d1717087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:31.181806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938bfaa-b2d7-4eba-a6d4-06a6d1717087 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:31.182144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545db0e-16ca-4f6f-ba2f-483b2c7e03e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:31.182584 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938bfaa-b2d7-4eba-a6d4-06a6d1717087 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:31.183030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938bfaa-b2d7-4eba-a6d4-06a6d1717087 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:31.183989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938bfaa-b2d7-4eba-a6d4-06a6d1717087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:31.184379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545db0e-16ca-4f6f-ba2f-483b2c7e03e7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:31.184587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938bfaa-b2d7-4eba-a6d4-06a6d1717087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:31.186110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938bfaa-b2d7-4eba-a6d4-06a6d1717087 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:31.204813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 364/734] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:31.207320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee47f0a-bfcb-442d-88d2-02b0032c9dd0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:31.207769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee47f0a-bfcb-442d-88d2-02b0032c9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:31.208186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee47f0a-bfcb-442d-88d2-02b0032c9dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:31.231770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-eee47f0a-bfcb-442d-88d2-02b0032c9dd0 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:31.233257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eee47f0a-bfcb-442d-88d2-02b0032c9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:31.308336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 371/735] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:31.309312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545db0e-16ca-4f6f-ba2f-483b2c7e03e7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:31.335254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 365/736] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:31.335254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee47f0a-bfcb-442d-88d2-02b0032c9dd0 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:31.427871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:31.490243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:31.543164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee47f0a-bfcb-442d-88d2-02b0032c9dd0 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:31.560640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545db0e-16ca-4f6f-ba2f-483b2c7e03e7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:31.599074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dbc31-ece2-438f-b65f-de17f063c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:31.599732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dbc31-ece2-438f-b65f-de17f063c374 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:31.600002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dbc31-ece2-438f-b65f-de17f063c374 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:31.600266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dbc31-ece2-438f-b65f-de17f063c374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:31.620459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dbc31-ece2-438f-b65f-de17f063c374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:31.621923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dbc31-ece2-438f-b65f-de17f063c374 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:31.635997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5991f-ce44-4817-a76b-98da98bb497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:31.636646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5991f-ce44-4817-a76b-98da98bb497e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:31.636917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5991f-ce44-4817-a76b-98da98bb497e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:31.637182 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5991f-ce44-4817-a76b-98da98bb497e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:31.648346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5991f-ce44-4817-a76b-98da98bb497e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:31.649843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5991f-ce44-4817-a76b-98da98bb497e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-543dbc31-ece2-438f-b65f-de17f063c374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:31.655431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:31.656434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:31.657937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:31.657937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:31.657937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:31.658583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 366/737] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:31.664237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dbc31-ece2-438f-b65f-de17f063c374 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c7d5991f-ce44-4817-a76b-98da98bb497e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:31.677774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:31.680185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:31.682526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 372/738] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:31.687210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5991f-ce44-4817-a76b-98da98bb497e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:31.794123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:31.810423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dbc31-ece2-438f-b65f-de17f063c374 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:31.851670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5991f-ce44-4817-a76b-98da98bb497e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:31.858675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad979209-b49e-4377-96fa-1dc23f9ce109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:31.859300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad979209-b49e-4377-96fa-1dc23f9ce109 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:31.859577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad979209-b49e-4377-96fa-1dc23f9ce109 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:31.859846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad979209-b49e-4377-96fa-1dc23f9ce109 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:31.861047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad979209-b49e-4377-96fa-1dc23f9ce109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:31.861351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad979209-b49e-4377-96fa-1dc23f9ce109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:31.863947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad979209-b49e-4377-96fa-1dc23f9ce109 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:31.880628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 367/739] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:31.881465 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad979209-b49e-4377-96fa-1dc23f9ce109 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:31.896359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcec6b0-4049-4abb-a9c0-e410823a4f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:31.896972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcec6b0-4049-4abb-a9c0-e410823a4f29 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:31.897244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcec6b0-4049-4abb-a9c0-e410823a4f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:31.897511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcec6b0-4049-4abb-a9c0-e410823a4f29 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:31.898252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcec6b0-4049-4abb-a9c0-e410823a4f29 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:31.898544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcec6b0-4049-4abb-a9c0-e410823a4f29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:31.900020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcec6b0-4049-4abb-a9c0-e410823a4f29 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:31.903583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:31.926339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 373/740] 10.222.0.78 () {56 vars in 1135 bytes} [Wed Aug 24 03:19:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:31.927314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcec6b0-4049-4abb-a9c0-e410823a4f29 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:32.001083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad979209-b49e-4377-96fa-1dc23f9ce109 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:32.041317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcec6b0-4049-4abb-a9c0-e410823a4f29 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:32.055455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a67f2-417f-45cf-8d71-0289e5c981fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:32.056463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a67f2-417f-45cf-8d71-0289e5c981fc None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.057066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a67f2-417f-45cf-8d71-0289e5c981fc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.057609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a67f2-417f-45cf-8d71-0289e5c981fc None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.058929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a67f2-417f-45cf-8d71-0289e5c981fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:32.061681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a67f2-417f-45cf-8d71-0289e5c981fc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:32.083171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc7a20-a6ef-4388-8c61-3f766545e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:32.084184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc7a20-a6ef-4388-8c61-3f766545e0be None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.084600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc7a20-a6ef-4388-8c61-3f766545e0be None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.085008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc7a20-a6ef-4388-8c61-3f766545e0be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.091215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 368/741] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:19:31 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:19:32.092612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a67f2-417f-45cf-8d71-0289e5c981fc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:32.094144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc7a20-a6ef-4388-8c61-3f766545e0be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:32.095889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc7a20-a6ef-4388-8c61-3f766545e0be None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-98cc7a20-a6ef-4388-8c61-3f766545e0be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:32.111160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:32.112127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:32.113240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:32.113240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:32.113240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:32.113240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:32.113240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:32.113240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:32.113240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:32.113240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:32.115676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:32.121603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 374/742] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:32.124253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc7a20-a6ef-4388-8c61-3f766545e0be None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:32.249234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:32.317666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc7a20-a6ef-4388-8c61-3f766545e0be None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:32.339691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a67f2-417f-45cf-8d71-0289e5c981fc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:32.367088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf3cf-2440-484c-9bd1-845eb11a96ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:32.367922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf3cf-2440-484c-9bd1-845eb11a96ed None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.368323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf3cf-2440-484c-9bd1-845eb11a96ed None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.368605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf3cf-2440-484c-9bd1-845eb11a96ed None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.369319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bf3cf-2440-484c-9bd1-845eb11a96ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:32.369621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bf3cf-2440-484c-9bd1-845eb11a96ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:32.371768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bf3cf-2440-484c-9bd1-845eb11a96ed None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:32.384349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5effc1-ab2c-4eb3-bc17-ef7d6d5fa5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:32.385254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5effc1-ab2c-4eb3-bc17-ef7d6d5fa5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.385669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5effc1-ab2c-4eb3-bc17-ef7d6d5fa5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.386080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5effc1-ab2c-4eb3-bc17-ef7d6d5fa5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.387951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 375/743] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:32.393816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf3cf-2440-484c-9bd1-845eb11a96ed None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:32.466233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5effc1-ab2c-4eb3-bc17-ef7d6d5fa5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:32.468130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5effc1-ab2c-4eb3-bc17-ef7d6d5fa5a7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:32.487064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:32.533431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf3cf-2440-484c-9bd1-845eb11a96ed None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:32.550383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:32.578766 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29879-aa8c-4536-8355-ef888c0171f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:32.578766 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29879-aa8c-4536-8355-ef888c0171f1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.578766 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29879-aa8c-4536-8355-ef888c0171f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.578766 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29879-aa8c-4536-8355-ef888c0171f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.579154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a29879-aa8c-4536-8355-ef888c0171f1 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=f988895119ea43448a4a0f4e4a0274bd) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:32.579154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a29879-aa8c-4536-8355-ef888c0171f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:32.580684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a29879-aa8c-4536-8355-ef888c0171f1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:32.596355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 376/744] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:32 2022] GET /identity/v3/role_assignments?user.id=f988895119ea43448a4a0f4e4a0274bd&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:32.636061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 369/745] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:32 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:32.641945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29879-aa8c-4536-8355-ef888c0171f1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:32.785678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29879-aa8c-4536-8355-ef888c0171f1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:32.790207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4bcd5-31c7-4951-86fc-840a755ec3b7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.790480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4bcd5-31c7-4951-86fc-840a755ec3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.790777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4bcd5-31c7-4951-86fc-840a755ec3b7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.792386 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 370/746] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:32.798284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693544-a157-4d3c-bd8a-640bea6497d6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.798904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693544-a157-4d3c-bd8a-640bea6497d6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.799389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693544-a157-4d3c-bd8a-640bea6497d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.820972 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d8693544-a157-4d3c-bd8a-640bea6497d6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:32.822996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d8693544-a157-4d3c-bd8a-640bea6497d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:32.824730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5dd26-2053-4b2c-9814-c6a60f65fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:32.825155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5dd26-2053-4b2c-9814-c6a60f65fb22 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.825482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5dd26-2053-4b2c-9814-c6a60f65fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.825756 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5dd26-2053-4b2c-9814-c6a60f65fb22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.838137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5dd26-2053-4b2c-9814-c6a60f65fb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:32.846678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5dd26-2053-4b2c-9814-c6a60f65fb22 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8aa5dd26-2053-4b2c-9814-c6a60f65fb22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:32.855876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:32.856863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:32.857738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:32.857738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:32.857738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:32.857738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 377/747] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:32.858593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c220792-7c9a-429b-874d-a22f3afa59fe None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.862680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c220792-7c9a-429b-874d-a22f3afa59fe None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.862680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c220792-7c9a-429b-874d-a22f3afa59fe None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.862680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 378/748] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:32.864853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c220792-7c9a-429b-874d-a22f3afa59fe None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:32.901090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:32.915062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 371/749] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:19:32.916407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d360b-a2a0-4759-9f24-dcdcb3976d82 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:32.916857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d360b-a2a0-4759-9f24-dcdcb3976d82 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:32.917189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d360b-a2a0-4759-9f24-dcdcb3976d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:32.935986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-261d360b-a2a0-4759-9f24-dcdcb3976d82 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:32.937237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-261d360b-a2a0-4759-9f24-dcdcb3976d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:32.966895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:32.983543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c220792-7c9a-429b-874d-a22f3afa59fe None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:33.020472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 372/750] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:19:33.062024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5a0fd-b4d2-4ee0-b13b-ef2cb46970b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:33.062715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5a0fd-b4d2-4ee0-b13b-ef2cb46970b3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:33.062995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5a0fd-b4d2-4ee0-b13b-ef2cb46970b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:33.063265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5a0fd-b4d2-4ee0-b13b-ef2cb46970b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:33.063982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5a0fd-b4d2-4ee0-b13b-ef2cb46970b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:33.064285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5a0fd-b4d2-4ee0-b13b-ef2cb46970b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:33.065665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5a0fd-b4d2-4ee0-b13b-ef2cb46970b3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:33.090065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 379/751] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:33.098437 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d360b-a2a0-4759-9f24-dcdcb3976d82 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:33.239171 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d360b-a2a0-4759-9f24-dcdcb3976d82 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:33.281805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5a0fd-b4d2-4ee0-b13b-ef2cb46970b3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:33.299498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0784d-3117-4add-bd5e-99dba5516b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:33.300740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0784d-3117-4add-bd5e-99dba5516b52 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:33.301416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0784d-3117-4add-bd5e-99dba5516b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:33.301905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0784d-3117-4add-bd5e-99dba5516b52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:33.319873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0784d-3117-4add-bd5e-99dba5516b52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:33.321722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0784d-3117-4add-bd5e-99dba5516b52 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-fba0784d-3117-4add-bd5e-99dba5516b52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:33.348508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:33.349407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:33.350273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:33.350273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:33.350273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:33.350273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:33.350273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:33.350273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:33.350273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:33.350273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:33.352803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 373/752] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:33.358723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0784d-3117-4add-bd5e-99dba5516b52 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:33.387462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:33.392068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:33.414646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5a0fd-b4d2-4ee0-b13b-ef2cb46970b3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:33.485860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fd9b0-7e2b-4b98-8d95-e7acb9e5007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:33.486506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fd9b0-7e2b-4b98-8d95-e7acb9e5007d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:33.486825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fd9b0-7e2b-4b98-8d95-e7acb9e5007d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:33.487092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fd9b0-7e2b-4b98-8d95-e7acb9e5007d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:33.499448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fd9b0-7e2b-4b98-8d95-e7acb9e5007d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ad9fd9b0-7e2b-4b98-8d95-e7acb9e5007d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:33.504596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:33.505535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:33.506365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 380/753] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:33.507068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fd9b0-7e2b-4b98-8d95-e7acb9e5007d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:33.507641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0784d-3117-4add-bd5e-99dba5516b52 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:33.550681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51df3-606d-40eb-9519-89886d09e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:33.551318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51df3-606d-40eb-9519-89886d09e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:33.551598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51df3-606d-40eb-9519-89886d09e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:33.551921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be51df3-606d-40eb-9519-89886d09e5e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:33.552649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be51df3-606d-40eb-9519-89886d09e5e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:33.552957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be51df3-606d-40eb-9519-89886d09e5e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:33.554516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be51df3-606d-40eb-9519-89886d09e5e6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:33.568957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 374/754] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:33.569823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51df3-606d-40eb-9519-89886d09e5e6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:33.662728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fd9b0-7e2b-4b98-8d95-e7acb9e5007d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:33.708034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acb390-a93c-4cac-b3a8-0b58f2617388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:33.708673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acb390-a93c-4cac-b3a8-0b58f2617388 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:33.708947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acb390-a93c-4cac-b3a8-0b58f2617388 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:33.709214 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acb390-a93c-4cac-b3a8-0b58f2617388 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:33.709883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acb390-a93c-4cac-b3a8-0b58f2617388 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:33.711333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acb390-a93c-4cac-b3a8-0b58f2617388 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:33.733562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 381/755] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:19:33 2022] POST /identity/v3/services => generated 240 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:19:33.734555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acb390-a93c-4cac-b3a8-0b58f2617388 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:33.779118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:33.851098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:33.860101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be51df3-606d-40eb-9519-89886d09e5e6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:33.945920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acb390-a93c-4cac-b3a8-0b58f2617388 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:33.952125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb695e3-5bef-4ce5-b1de-e4c498bc2465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:33.953752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb695e3-5bef-4ce5-b1de-e4c498bc2465 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:33.954271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb695e3-5bef-4ce5-b1de-e4c498bc2465 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:33.954853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb695e3-5bef-4ce5-b1de-e4c498bc2465 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:33.955766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb695e3-5bef-4ce5-b1de-e4c498bc2465 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:33.957190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb695e3-5bef-4ce5-b1de-e4c498bc2465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:33.959691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb695e3-5bef-4ce5-b1de-e4c498bc2465 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:33.978292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 375/756] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:33.980650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb695e3-5bef-4ce5-b1de-e4c498bc2465 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:33.997297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ffa79-8710-4bce-acef-395092e191e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:33.997913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ffa79-8710-4bce-acef-395092e191e5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:33.998190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ffa79-8710-4bce-acef-395092e191e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:33.998454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ffa79-8710-4bce-acef-395092e191e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:33.999241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ffa79-8710-4bce-acef-395092e191e5 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=c72dc03535044d6a97a953256839d413) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:33.999599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ffa79-8710-4bce-acef-395092e191e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:34.001220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ffa79-8710-4bce-acef-395092e191e5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:34.015173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 382/757] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:33 2022] GET /identity/v3/role_assignments?user.id=c72dc03535044d6a97a953256839d413&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:34.111268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb695e3-5bef-4ce5-b1de-e4c498bc2465 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:34.154435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdbaaf-7fb1-4046-b7e2-0293bf05346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:34.155131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdbaaf-7fb1-4046-b7e2-0293bf05346f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:34.155407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdbaaf-7fb1-4046-b7e2-0293bf05346f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:34.155673 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdbaaf-7fb1-4046-b7e2-0293bf05346f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:34.168463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdbaaf-7fb1-4046-b7e2-0293bf05346f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:34.169943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdbaaf-7fb1-4046-b7e2-0293bf05346f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:34.178598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-21bdbaaf-7fb1-4046-b7e2-0293bf05346f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:34.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:34.189949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:34.191153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:34.191153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:34.191153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:34.191153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 376/758] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:34.198250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ffa79-8710-4bce-acef-395092e191e5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:34.296999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:34.341519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ffa79-8710-4bce-acef-395092e191e5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:34.395689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9093df-2744-4e18-afe0-97a3d391e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:34.396336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9093df-2744-4e18-afe0-97a3d391e193 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:34.396611 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9093df-2744-4e18-afe0-97a3d391e193 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:34.396872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9093df-2744-4e18-afe0-97a3d391e193 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:34.397535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9093df-2744-4e18-afe0-97a3d391e193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:34.397829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9093df-2744-4e18-afe0-97a3d391e193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:34.399268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9093df-2744-4e18-afe0-97a3d391e193 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:34.418424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 383/759] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:34.424310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdbaaf-7fb1-4046-b7e2-0293bf05346f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:34.556813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdbaaf-7fb1-4046-b7e2-0293bf05346f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:34.584371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dea74-a2d0-4cc0-bd7a-fa50abb2d492 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:34.584736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dea74-a2d0-4cc0-bd7a-fa50abb2d492 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:34.584903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dea74-a2d0-4cc0-bd7a-fa50abb2d492 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:34.586523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 384/760] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:34.591895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b73e9d-9a2d-4f30-9610-744d3bf960d8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:34.592177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b73e9d-9a2d-4f30-9610-744d3bf960d8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:34.592429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b73e9d-9a2d-4f30-9610-744d3bf960d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:34.597039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214eebe-a306-48a7-a6ee-af6440c9c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:34.598176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214eebe-a306-48a7-a6ee-af6440c9c464 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:34.598691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214eebe-a306-48a7-a6ee-af6440c9c464 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:34.599161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214eebe-a306-48a7-a6ee-af6440c9c464 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:34.608495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214eebe-a306-48a7-a6ee-af6440c9c464 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:34.610329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214eebe-a306-48a7-a6ee-af6440c9c464 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-2214eebe-a306-48a7-a6ee-af6440c9c464 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:34.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:34.625443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:34.626416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:34.633966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 377/761] 10.222.0.78 () {56 vars in 1093 bytes} [Wed Aug 24 03:19:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:34.635755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214eebe-a306-48a7-a6ee-af6440c9c464 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:34.640744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-83b73e9d-9a2d-4f30-9610-744d3bf960d8 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:34.641598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-83b73e9d-9a2d-4f30-9610-744d3bf960d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:34.736841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 385/762] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 24 03:19:34.750598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:34.797249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214eebe-a306-48a7-a6ee-af6440c9c464 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:34.834938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a456c4-6596-4c62-bf71-5f12dba4c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:34.835481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a456c4-6596-4c62-bf71-5f12dba4c6bf None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:34.835760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a456c4-6596-4c62-bf71-5f12dba4c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:34.836030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a456c4-6596-4c62-bf71-5f12dba4c6bf None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:34.836787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a456c4-6596-4c62-bf71-5f12dba4c6bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:34.837090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a456c4-6596-4c62-bf71-5f12dba4c6bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:34.838609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a456c4-6596-4c62-bf71-5f12dba4c6bf None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:34.859213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 378/763] 10.222.0.78 () {56 vars in 1133 bytes} [Wed Aug 24 03:19:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:34.865366 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b73e9d-9a2d-4f30-9610-744d3bf960d8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:34.978581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:35.043343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b73e9d-9a2d-4f30-9610-744d3bf960d8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:35.060894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a456c4-6596-4c62-bf71-5f12dba4c6bf None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:35.100201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5c47c-147c-4820-9753-5d1dd4a41c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:35.101309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5c47c-147c-4820-9753-5d1dd4a41c23 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.101808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5c47c-147c-4820-9753-5d1dd4a41c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.102325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5c47c-147c-4820-9753-5d1dd4a41c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.115154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5c47c-147c-4820-9753-5d1dd4a41c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:35.117077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5c47c-147c-4820-9753-5d1dd4a41c23 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f1b5c47c-147c-4820-9753-5d1dd4a41c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:35.134613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:35.135685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:35.136575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:35.136575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:35.136575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:35.143323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 386/764] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:35.145268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05749ef-7093-4434-8d91-33e525a1e6fd None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.145788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05749ef-7093-4434-8d91-33e525a1e6fd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.146280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05749ef-7093-4434-8d91-33e525a1e6fd None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.148453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 387/765] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:35.156663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05749ef-7093-4434-8d91-33e525a1e6fd None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:35.181067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a456c4-6596-4c62-bf71-5f12dba4c6bf None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:35.200591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:35.220311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a77a3-8a4b-4eb6-9b78-2ee1c86c4d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:35.220956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a77a3-8a4b-4eb6-9b78-2ee1c86c4d62 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.221289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a77a3-8a4b-4eb6-9b78-2ee1c86c4d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.221560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a77a3-8a4b-4eb6-9b78-2ee1c86c4d62 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.222262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a77a3-8a4b-4eb6-9b78-2ee1c86c4d62 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:35.223650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a77a3-8a4b-4eb6-9b78-2ee1c86c4d62 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-341a77a3-8a4b-4eb6-9b78-2ee1c86c4d62 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:35.233060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:35.234109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:19:35.235019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:35.239455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 379/766] 10.222.0.78 () {56 vars in 1129 bytes} [Wed Aug 24 03:19:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:35.240943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2ccd9-43fb-4940-ae58-04b743efa828 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.241220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2ccd9-43fb-4940-ae58-04b743efa828 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.241484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2ccd9-43fb-4940-ae58-04b743efa828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.260496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-48a2ccd9-43fb-4940-ae58-04b743efa828 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:35.261723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-48a2ccd9-43fb-4940-ae58-04b743efa828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:35.293811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05749ef-7093-4434-8d91-33e525a1e6fd None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:35.309893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:35.336443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3befdf6-5e91-4141-a711-ee0c29e53a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:35.337446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3befdf6-5e91-4141-a711-ee0c29e53a82 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.337926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3befdf6-5e91-4141-a711-ee0c29e53a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.338397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3befdf6-5e91-4141-a711-ee0c29e53a82 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.339352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3befdf6-5e91-4141-a711-ee0c29e53a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:35.339881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3befdf6-5e91-4141-a711-ee0c29e53a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:35.341510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3befdf6-5e91-4141-a711-ee0c29e53a82 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:35.343101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 380/767] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:35.344394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2ccd9-43fb-4940-ae58-04b743efa828 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:35.364525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 388/768] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:35.366347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3befdf6-5e91-4141-a711-ee0c29e53a82 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:35.489842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3befdf6-5e91-4141-a711-ee0c29e53a82 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:35.530079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05f41-4306-460f-beb7-57f57f8be6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:35.531227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05f41-4306-460f-beb7-57f57f8be6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.531737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05f41-4306-460f-beb7-57f57f8be6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.532236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05f41-4306-460f-beb7-57f57f8be6d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.547514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f05f41-4306-460f-beb7-57f57f8be6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:35.549617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f05f41-4306-460f-beb7-57f57f8be6d3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f4f05f41-4306-460f-beb7-57f57f8be6d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:35.574498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:35.575490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:35.576375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:35.576375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:35.576375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:35.576375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:35.576375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:35.576375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:35.576375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:35.576375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:35.579051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 389/769] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:35.584490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05f41-4306-460f-beb7-57f57f8be6d3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:35.607187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2ccd9-43fb-4940-ae58-04b743efa828 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:35.640440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:35.661535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:35.687983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944f37-44ef-4241-b857-5de099ea3d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:35.688733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944f37-44ef-4241-b857-5de099ea3d48 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.689013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944f37-44ef-4241-b857-5de099ea3d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.689353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944f37-44ef-4241-b857-5de099ea3d48 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.690085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10944f37-44ef-4241-b857-5de099ea3d48 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:35.690530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10944f37-44ef-4241-b857-5de099ea3d48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:35.692146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10944f37-44ef-4241-b857-5de099ea3d48 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:35.700826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 381/770] 10.222.0.78 () {56 vars in 1124 bytes} [Wed Aug 24 03:19:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:35.702506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944f37-44ef-4241-b857-5de099ea3d48 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:35.748100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05f41-4306-460f-beb7-57f57f8be6d3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:35.785726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694f672-b5d6-4c3b-bac8-44420a10cd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:35.786814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694f672-b5d6-4c3b-bac8-44420a10cd63 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.787296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694f672-b5d6-4c3b-bac8-44420a10cd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.787765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694f672-b5d6-4c3b-bac8-44420a10cd63 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.788675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694f672-b5d6-4c3b-bac8-44420a10cd63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:35.789178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694f672-b5d6-4c3b-bac8-44420a10cd63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:35.790865 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694f672-b5d6-4c3b-bac8-44420a10cd63 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:35.809353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 390/771] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:35.810673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694f672-b5d6-4c3b-bac8-44420a10cd63 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:35.815611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944f37-44ef-4241-b857-5de099ea3d48 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:35.854387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77362b-3964-4598-a37d-10bb104844ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:35.855070 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77362b-3964-4598-a37d-10bb104844ba None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.855346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77362b-3964-4598-a37d-10bb104844ba None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.855681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77362b-3964-4598-a37d-10bb104844ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.868337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77362b-3964-4598-a37d-10bb104844ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-7f77362b-3964-4598-a37d-10bb104844ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:35.873470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:35.874486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 382/772] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:35.876038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77362b-3964-4598-a37d-10bb104844ba None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:35.920041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:35.920229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:35.931968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694f672-b5d6-4c3b-bac8-44420a10cd63 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:35.975944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683c0a-4d03-46d6-bac7-b7ed988507b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:35.976956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683c0a-4d03-46d6-bac7-b7ed988507b2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:35.977432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683c0a-4d03-46d6-bac7-b7ed988507b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:35.977896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683c0a-4d03-46d6-bac7-b7ed988507b2 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:35.978793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683c0a-4d03-46d6-bac7-b7ed988507b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:35.979330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683c0a-4d03-46d6-bac7-b7ed988507b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:35.980934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683c0a-4d03-46d6-bac7-b7ed988507b2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:35.987228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 391/773] 10.222.0.78 () {56 vars in 1124 bytes} [Wed Aug 24 03:19:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:35.988850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683c0a-4d03-46d6-bac7-b7ed988507b2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:36.012119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77362b-3964-4598-a37d-10bb104844ba None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:36.055231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3299953-b25c-48d5-81b8-69285880e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:36.056920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299953-b25c-48d5-81b8-69285880e789 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.058205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299953-b25c-48d5-81b8-69285880e789 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.059130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299953-b25c-48d5-81b8-69285880e789 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/438786dead414066a6ef101a2493fb8c/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.063460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3299953-b25c-48d5-81b8-69285880e789 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=438786dead414066a6ef101a2493fb8c, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:36.066747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3299953-b25c-48d5-81b8-69285880e789 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:36.094708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 383/774] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:19:35 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/438786dead414066a6ef101a2493fb8c/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:19:36.094708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3299953-b25c-48d5-81b8-69285880e789 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:36.151272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683c0a-4d03-46d6-bac7-b7ed988507b2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:36.230592 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79923ad7-3794-431e-9efb-98860cad6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:36.231249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79923ad7-3794-431e-9efb-98860cad6404 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.231522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79923ad7-3794-431e-9efb-98860cad6404 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.231898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79923ad7-3794-431e-9efb-98860cad6404 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.232488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79923ad7-3794-431e-9efb-98860cad6404 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:36.232792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79923ad7-3794-431e-9efb-98860cad6404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:36.234222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79923ad7-3794-431e-9efb-98860cad6404 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:36.254971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 392/775] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:36.265548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79923ad7-3794-431e-9efb-98860cad6404 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:36.305937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:36.306141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:36.314306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3299953-b25c-48d5-81b8-69285880e789 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:36.361017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81f2e3-aa1e-4900-8b3f-471d10a34f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:36.361682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f2e3-aa1e-4900-8b3f-471d10a34f50 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.361957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f2e3-aa1e-4900-8b3f-471d10a34f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.362226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f2e3-aa1e-4900-8b3f-471d10a34f50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.363624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81f2e3-aa1e-4900-8b3f-471d10a34f50 None admin] RBAC: Adding query filter params (interface=public, service_id=5f1efa6b522e4d9e834371ff339ea9a1, region_id=RegionOne) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:36.363984 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81f2e3-aa1e-4900-8b3f-471d10a34f50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:36.365659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81f2e3-aa1e-4900-8b3f-471d10a34f50 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:36.376767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 384/776] 10.222.0.78 () {56 vars in 1251 bytes} [Wed Aug 24 03:19:36 2022] GET /identity/v3/endpoints?service_id=5f1efa6b522e4d9e834371ff339ea9a1&interface=public®ion_id=RegionOne => generated 194 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:36.378414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c1da0-dbfc-4964-bca6-50e144022a2d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.382784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c1da0-dbfc-4964-bca6-50e144022a2d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.384874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c1da0-dbfc-4964-bca6-50e144022a2d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.386574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 385/777] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:36.388868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c1da0-dbfc-4964-bca6-50e144022a2d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:36.443087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79923ad7-3794-431e-9efb-98860cad6404 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:36.504920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdde4c5-0d18-468b-9562-e0021ff5c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:36.505933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdde4c5-0d18-468b-9562-e0021ff5c38e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.506407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdde4c5-0d18-468b-9562-e0021ff5c38e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.506934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdde4c5-0d18-468b-9562-e0021ff5c38e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.528007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdde4c5-0d18-468b-9562-e0021ff5c38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:36.530615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdde4c5-0d18-468b-9562-e0021ff5c38e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:36.536556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c1da0-dbfc-4964-bca6-50e144022a2d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8fdde4c5-0d18-468b-9562-e0021ff5c38e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:36.557283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:36.558316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:36.559317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:36.559317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:36.559317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:36.563122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 393/778] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:36.565390 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09470f0d-677a-4309-bcdd-e9a235841d39 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.565877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09470f0d-677a-4309-bcdd-e9a235841d39 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.566279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09470f0d-677a-4309-bcdd-e9a235841d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.586124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f92e8-3fb5-46fe-a2ed-c3f133329492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:36.586809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f92e8-3fb5-46fe-a2ed-c3f133329492 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.590181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f92e8-3fb5-46fe-a2ed-c3f133329492 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.590181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f92e8-3fb5-46fe-a2ed-c3f133329492 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.590181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f92e8-3fb5-46fe-a2ed-c3f133329492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:36.590181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f92e8-3fb5-46fe-a2ed-c3f133329492 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:36.591882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-09470f0d-677a-4309-bcdd-e9a235841d39 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:36.593065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-09470f0d-677a-4309-bcdd-e9a235841d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:36.602816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 386/779] 10.222.0.78 () {56 vars in 1087 bytes} [Wed Aug 24 03:19:36 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:36.602816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cd683-d2f0-44c3-b8f9-a8cf0358f5f2 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.602816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cd683-d2f0-44c3-b8f9-a8cf0358f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.602816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cd683-d2f0-44c3-b8f9-a8cf0358f5f2 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.602816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 387/780] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:36.602816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cd683-d2f0-44c3-b8f9-a8cf0358f5f2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:36.643182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:36.681989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 394/781] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:36.683917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff31e0-55f9-4eb0-8d0f-5e2d507b6d0f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.684416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff31e0-55f9-4eb0-8d0f-5e2d507b6d0f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.684832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff31e0-55f9-4eb0-8d0f-5e2d507b6d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.691780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:36.711216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5eff31e0-55f9-4eb0-8d0f-5e2d507b6d0f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:36.713813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5eff31e0-55f9-4eb0-8d0f-5e2d507b6d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:36.801947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cd683-d2f0-44c3-b8f9-a8cf0358f5f2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:36.843754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 395/782] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:36.864173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4208cc-c413-40c1-81cb-13e22b01b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:36.865618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4208cc-c413-40c1-81cb-13e22b01b103 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:36.866299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4208cc-c413-40c1-81cb-13e22b01b103 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:36.867056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4208cc-c413-40c1-81cb-13e22b01b103 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:36.868403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4208cc-c413-40c1-81cb-13e22b01b103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:36.869199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4208cc-c413-40c1-81cb-13e22b01b103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:36.872015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4208cc-c413-40c1-81cb-13e22b01b103 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:36.895402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 388/783] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:36.901167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff31e0-55f9-4eb0-8d0f-5e2d507b6d0f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.002279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4208cc-c413-40c1-81cb-13e22b01b103 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.111272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff31e0-55f9-4eb0-8d0f-5e2d507b6d0f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:37.122636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:37.158295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4208cc-c413-40c1-81cb-13e22b01b103 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:37.171109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:37.182085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206bfdb-e35a-4b67-a7ef-fba0228f032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:37.182822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206bfdb-e35a-4b67-a7ef-fba0228f032f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:37.183131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206bfdb-e35a-4b67-a7ef-fba0228f032f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:37.183408 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206bfdb-e35a-4b67-a7ef-fba0228f032f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:37.194672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206bfdb-e35a-4b67-a7ef-fba0228f032f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:37.196188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206bfdb-e35a-4b67-a7ef-fba0228f032f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8206bfdb-e35a-4b67-a7ef-fba0228f032f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:37.211011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:37.212033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 396/784] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:19:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:37.213647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206bfdb-e35a-4b67-a7ef-fba0228f032f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.216933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a60911-a203-440f-86a8-28d3aeed484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:37.218925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60911-a203-440f-86a8-28d3aeed484a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:37.219445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60911-a203-440f-86a8-28d3aeed484a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:37.219893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60911-a203-440f-86a8-28d3aeed484a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:37.233783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a60911-a203-440f-86a8-28d3aeed484a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-34a60911-a203-440f-86a8-28d3aeed484a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:37.239139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:37.240134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:37.241008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:37.243796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 389/785] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:37.244896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a60911-a203-440f-86a8-28d3aeed484a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.348897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206bfdb-e35a-4b67-a7ef-fba0228f032f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:37.386960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a60911-a203-440f-86a8-28d3aeed484a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:37.396304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523a091-b4ee-46d0-9fbc-279ae8ed8619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:37.397620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523a091-b4ee-46d0-9fbc-279ae8ed8619 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:37.398314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523a091-b4ee-46d0-9fbc-279ae8ed8619 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:37.398844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523a091-b4ee-46d0-9fbc-279ae8ed8619 None admin] PATH_INFO: `/v3/services/network` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:37.399729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523a091-b4ee-46d0-9fbc-279ae8ed8619 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:37.401373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523a091-b4ee-46d0-9fbc-279ae8ed8619 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-2523a091-b4ee-46d0-9fbc-279ae8ed8619 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:37.413630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:37.414848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:19:37.415836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:37.419776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 397/786] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:37 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:37.421104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523a091-b4ee-46d0-9fbc-279ae8ed8619 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.432121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b48fa-b36e-4fff-b328-8f925d5b3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:37.432748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b48fa-b36e-4fff-b328-8f925d5b3aef None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:37.433018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b48fa-b36e-4fff-b328-8f925d5b3aef None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:37.433284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b48fa-b36e-4fff-b328-8f925d5b3aef None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:37.434042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b48fa-b36e-4fff-b328-8f925d5b3aef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:37.434349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b48fa-b36e-4fff-b328-8f925d5b3aef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:37.436768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b48fa-b36e-4fff-b328-8f925d5b3aef None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:37.453370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:37.459713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 390/787] 10.222.0.78 () {56 vars in 1149 bytes} [Wed Aug 24 03:19:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:37.460986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b48fa-b36e-4fff-b328-8f925d5b3aef None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.491293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:37.542041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523a091-b4ee-46d0-9fbc-279ae8ed8619 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:37.584080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5ea5b-23ba-4932-abf3-53e89254c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:37.584879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5ea5b-23ba-4932-abf3-53e89254c22c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:37.585124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b48fa-b36e-4fff-b328-8f925d5b3aef None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:37.585347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5ea5b-23ba-4932-abf3-53e89254c22c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:37.585713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5ea5b-23ba-4932-abf3-53e89254c22c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:37.586500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5ea5b-23ba-4932-abf3-53e89254c22c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:37.587021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5ea5b-23ba-4932-abf3-53e89254c22c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:37.590377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5ea5b-23ba-4932-abf3-53e89254c22c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:37.601208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 398/788] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:37.602399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5ea5b-23ba-4932-abf3-53e89254c22c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.645183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beb1a3-9d04-4811-bdab-438c81c255cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:37.646168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb1a3-9d04-4811-bdab-438c81c255cb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:37.646586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb1a3-9d04-4811-bdab-438c81c255cb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:37.647282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb1a3-9d04-4811-bdab-438c81c255cb None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:37.648405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beb1a3-9d04-4811-bdab-438c81c255cb None admin] RBAC: Adding query filter params (name=network) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:37.648872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beb1a3-9d04-4811-bdab-438c81c255cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:37.650501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beb1a3-9d04-4811-bdab-438c81c255cb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:37.661757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 391/789] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:19:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:37.663225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beb1a3-9d04-4811-bdab-438c81c255cb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.743607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:37.761500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5ea5b-23ba-4932-abf3-53e89254c22c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:37.782750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:37.795539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beb1a3-9d04-4811-bdab-438c81c255cb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:37.808279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e256-9f5d-4496-9e9c-d7e4e811a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:37.809022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e256-9f5d-4496-9e9c-d7e4e811a9fd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:37.809375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e256-9f5d-4496-9e9c-d7e4e811a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:37.809717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e256-9f5d-4496-9e9c-d7e4e811a9fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:37.824974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477e256-9f5d-4496-9e9c-d7e4e811a9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:37.827236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477e256-9f5d-4496-9e9c-d7e4e811a9fd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:37.838562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da91af-b080-483b-afab-13f3d7cca492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:37.839521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da91af-b080-483b-afab-13f3d7cca492 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:37.839975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da91af-b080-483b-afab-13f3d7cca492 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:37.840412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da91af-b080-483b-afab-13f3d7cca492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3477e256-9f5d-4496-9e9c-d7e4e811a9fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:37.845615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:37.847646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:37.848815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:37.848815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:37.848815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:37.848815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 399/790] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:37.848815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e256-9f5d-4496-9e9c-d7e4e811a9fd None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.858292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da91af-b080-483b-afab-13f3d7cca492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:37.860629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da91af-b080-483b-afab-13f3d7cca492 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-08da91af-b080-483b-afab-13f3d7cca492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:37.880711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:37.881775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:37.882874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:37.882874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:37.882874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:37.885511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 392/791] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:37.886612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da91af-b080-483b-afab-13f3d7cca492 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:37.974892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e256-9f5d-4496-9e9c-d7e4e811a9fd None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:38.020136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da91af-b080-483b-afab-13f3d7cca492 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:38.025780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d544b8-bb95-47b5-aa8a-1471686bc4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:38.026894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d544b8-bb95-47b5-aa8a-1471686bc4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.027387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d544b8-bb95-47b5-aa8a-1471686bc4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.027905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d544b8-bb95-47b5-aa8a-1471686bc4c2 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.028840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d544b8-bb95-47b5-aa8a-1471686bc4c2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:38.029322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d544b8-bb95-47b5-aa8a-1471686bc4c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:38.031884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d544b8-bb95-47b5-aa8a-1471686bc4c2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:38.044610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 400/792] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:19:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:38.044610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d544b8-bb95-47b5-aa8a-1471686bc4c2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:38.049883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:38.077361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f1c84-f72c-465a-b3de-c9383cfd6aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:38.078083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f1c84-f72c-465a-b3de-c9383cfd6aae None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.078357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f1c84-f72c-465a-b3de-c9383cfd6aae None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.078724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f1c84-f72c-465a-b3de-c9383cfd6aae None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.079436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f1c84-f72c-465a-b3de-c9383cfd6aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:38.079738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f1c84-f72c-465a-b3de-c9383cfd6aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:38.081176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f1c84-f72c-465a-b3de-c9383cfd6aae None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:38.102443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 393/793] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:38.105785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f1c84-f72c-465a-b3de-c9383cfd6aae None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:38.112233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:38.217520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d544b8-bb95-47b5-aa8a-1471686bc4c2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:38.256702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f1c84-f72c-465a-b3de-c9383cfd6aae None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:38.262527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea4a5e-aafd-4b39-ac18-578fb82dbb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:38.263560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4a5e-aafd-4b39-ac18-578fb82dbb20 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.264070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4a5e-aafd-4b39-ac18-578fb82dbb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.264527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4a5e-aafd-4b39-ac18-578fb82dbb20 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.265380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea4a5e-aafd-4b39-ac18-578fb82dbb20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:38.265876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea4a5e-aafd-4b39-ac18-578fb82dbb20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:38.267474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea4a5e-aafd-4b39-ac18-578fb82dbb20 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:38.291349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 401/794] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:38.291349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea4a5e-aafd-4b39-ac18-578fb82dbb20 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:38.328142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab0ab-d9d3-4366-a82b-7c75487b7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:38.329127 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab0ab-d9d3-4366-a82b-7c75487b7e82 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.329598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab0ab-d9d3-4366-a82b-7c75487b7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.330050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab0ab-d9d3-4366-a82b-7c75487b7e82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.331450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab0ab-d9d3-4366-a82b-7c75487b7e82 None admin] RBAC: Adding query filter params (interface=public, service_id=d30d2c0e8f604c41be5d8718eb4d9c44, region_id=RegionOne) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:38.332000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab0ab-d9d3-4366-a82b-7c75487b7e82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:38.334486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab0ab-d9d3-4366-a82b-7c75487b7e82 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:38.343731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 394/795] 10.222.0.78 () {56 vars in 1251 bytes} [Wed Aug 24 03:19:38 2022] GET /identity/v3/endpoints?service_id=d30d2c0e8f604c41be5d8718eb4d9c44&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:38.345136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab0ab-d9d3-4366-a82b-7c75487b7e82 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:38.400146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:38.418374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:38.435178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea4a5e-aafd-4b39-ac18-578fb82dbb20 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:38.471836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab0ab-d9d3-4366-a82b-7c75487b7e82 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:38.484483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b277a-dd5f-4698-ac54-b0f37bc3ff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:38.485531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b277a-dd5f-4698-ac54-b0f37bc3ff6b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.485987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b277a-dd5f-4698-ac54-b0f37bc3ff6b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.486440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b277a-dd5f-4698-ac54-b0f37bc3ff6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.494995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b277a-dd5f-4698-ac54-b0f37bc3ff6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:38.496714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b277a-dd5f-4698-ac54-b0f37bc3ff6b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-270b277a-dd5f-4698-ac54-b0f37bc3ff6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:38.510804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:38.511901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:38.513009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:38.513009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:38.513009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:38.513009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:38.513009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:38.513009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:38.513009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:38.513009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:38.518739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080c308-cb56-4fdc-a8fa-3603009a647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:38.518739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c308-cb56-4fdc-a8fa-3603009a647d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.518739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c308-cb56-4fdc-a8fa-3603009a647d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.518739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c308-cb56-4fdc-a8fa-3603009a647d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.519981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 402/796] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:38.521287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5183d2f-5e6f-4ab9-9a43-a1bcd63a0c68 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.521572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5183d2f-5e6f-4ab9-9a43-a1bcd63a0c68 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.521845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5183d2f-5e6f-4ab9-9a43-a1bcd63a0c68 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.523643 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 403/797] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:38.523949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5183d2f-5e6f-4ab9-9a43-a1bcd63a0c68 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:38.532207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080c308-cb56-4fdc-a8fa-3603009a647d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:38.533683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080c308-cb56-4fdc-a8fa-3603009a647d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4080c308-cb56-4fdc-a8fa-3603009a647d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:38.547458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:38.548746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 395/798] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:38.550869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080c308-cb56-4fdc-a8fa-3603009a647d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:38.664697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5183d2f-5e6f-4ab9-9a43-a1bcd63a0c68 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:38.669587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:38.673442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080c308-cb56-4fdc-a8fa-3603009a647d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:38.702237 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb192a-d2f5-4839-8b69-79c9aa3923dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:38.702893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb192a-d2f5-4839-8b69-79c9aa3923dd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.703195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb192a-d2f5-4839-8b69-79c9aa3923dd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.703467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb192a-d2f5-4839-8b69-79c9aa3923dd None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.704144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb192a-d2f5-4839-8b69-79c9aa3923dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:38.705656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb192a-d2f5-4839-8b69-79c9aa3923dd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:38.722750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 404/799] 10.222.0.78 () {56 vars in 1087 bytes} [Wed Aug 24 03:19:38 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:38.722750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b062-8a54-4031-9c35-06f88eca208b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.722750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b062-8a54-4031-9c35-06f88eca208b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.722750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b062-8a54-4031-9c35-06f88eca208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.727592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f79f3-cd40-4ec4-ad25-8ce1d19c4e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:38.728422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f79f3-cd40-4ec4-ad25-8ce1d19c4e5a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.728859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f79f3-cd40-4ec4-ad25-8ce1d19c4e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.729230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f79f3-cd40-4ec4-ad25-8ce1d19c4e5a None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.730140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f79f3-cd40-4ec4-ad25-8ce1d19c4e5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:38.730553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f79f3-cd40-4ec4-ad25-8ce1d19c4e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:38.732443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f79f3-cd40-4ec4-ad25-8ce1d19c4e5a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:38.742061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5226b062-8a54-4031-9c35-06f88eca208b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:38.743710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5226b062-8a54-4031-9c35-06f88eca208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:38.748356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 396/800] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:38.755206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f79f3-cd40-4ec4-ad25-8ce1d19c4e5a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:38.759940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:38.842784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 405/801] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:38.842784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226b062-8a54-4031-9c35-06f88eca208b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:38.925884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f79f3-cd40-4ec4-ad25-8ce1d19c4e5a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:38.976603 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bf5e8-985a-4ab1-b543-d44d35004e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:38.977583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bf5e8-985a-4ab1-b543-d44d35004e30 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:38.978052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bf5e8-985a-4ab1-b543-d44d35004e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:38.978489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bf5e8-985a-4ab1-b543-d44d35004e30 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:38.979870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bf5e8-985a-4ab1-b543-d44d35004e30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:38.980410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bf5e8-985a-4ab1-b543-d44d35004e30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:38.983049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bf5e8-985a-4ab1-b543-d44d35004e30 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:39.010164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226b062-8a54-4031-9c35-06f88eca208b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:39.018257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 397/802] 10.222.0.78 () {56 vars in 1135 bytes} [Wed Aug 24 03:19:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:39.026077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf000bbb-c4db-48be-8b17-28aee4eccf80 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.026524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf000bbb-c4db-48be-8b17-28aee4eccf80 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.027019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf000bbb-c4db-48be-8b17-28aee4eccf80 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.033593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 398/803] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:39.033593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf000bbb-c4db-48be-8b17-28aee4eccf80 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:39.064241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a8de8-6339-4408-aaa5-fa0265e968f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:39.065484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a8de8-6339-4408-aaa5-fa0265e968f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.066326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:39.070636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a8de8-6339-4408-aaa5-fa0265e968f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.070865 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a8de8-6339-4408-aaa5-fa0265e968f2 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/f988895119ea43448a4a0f4e4a0274bd/roles/392e59acab294916b7e3713134f2a626` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.088428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a8de8-6339-4408-aaa5-fa0265e968f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=f988895119ea43448a4a0f4e4a0274bd, role_id=392e59acab294916b7e3713134f2a626)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:39.089959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a8de8-6339-4408-aaa5-fa0265e968f2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:39.093917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:39.109104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 406/804] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:19:38 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/f988895119ea43448a4a0f4e4a0274bd/roles/392e59acab294916b7e3713134f2a626 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:19:39.110971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a76b4-b1af-405f-b3f5-cfcc546fc220 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.111665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a76b4-b1af-405f-b3f5-cfcc546fc220 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.112084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a76b4-b1af-405f-b3f5-cfcc546fc220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.134239 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f65a76b4-b1af-405f-b3f5-cfcc546fc220 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:39.136070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f65a76b4-b1af-405f-b3f5-cfcc546fc220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:39.180230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf000bbb-c4db-48be-8b17-28aee4eccf80 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:39.224564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee55841-2eec-46f4-ad05-1d80a2fda67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:39.225470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee55841-2eec-46f4-ad05-1d80a2fda67f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.225885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee55841-2eec-46f4-ad05-1d80a2fda67f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.226148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 407/805] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:39.226471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee55841-2eec-46f4-ad05-1d80a2fda67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.227328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a76b4-b1af-405f-b3f5-cfcc546fc220 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:39.239369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee55841-2eec-46f4-ad05-1d80a2fda67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:39.241250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee55841-2eec-46f4-ad05-1d80a2fda67f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-cee55841-2eec-46f4-ad05-1d80a2fda67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:39.258397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:39.260001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:39.260896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:39.260896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:39.260896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:39.263167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 399/806] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:39.277957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee55841-2eec-46f4-ad05-1d80a2fda67f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:39.366527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a76b4-b1af-405f-b3f5-cfcc546fc220 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:39.393460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:39.415262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:39.431190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee55841-2eec-46f4-ad05-1d80a2fda67f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:39.432464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc57d-1729-4ae6-995f-6ee27ba7e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:39.433627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc57d-1729-4ae6-995f-6ee27ba7e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.434189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc57d-1729-4ae6-995f-6ee27ba7e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.434743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc57d-1729-4ae6-995f-6ee27ba7e7c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.452364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcc57d-1729-4ae6-995f-6ee27ba7e7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-76dcc57d-1729-4ae6-995f-6ee27ba7e7c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:39.458247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:39.459353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:39.460170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:39.460818 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 408/807] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:39.466151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc57d-1729-4ae6-995f-6ee27ba7e7c7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:39.475129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421bdcc-bfb6-4c47-a745-eea3d31d418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:39.475823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421bdcc-bfb6-4c47-a745-eea3d31d418e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.476179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421bdcc-bfb6-4c47-a745-eea3d31d418e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.476455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421bdcc-bfb6-4c47-a745-eea3d31d418e None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.477123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421bdcc-bfb6-4c47-a745-eea3d31d418e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:39.477464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421bdcc-bfb6-4c47-a745-eea3d31d418e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:39.479116 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421bdcc-bfb6-4c47-a745-eea3d31d418e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:39.493762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 400/808] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:39.500028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421bdcc-bfb6-4c47-a745-eea3d31d418e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:39.649074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421bdcc-bfb6-4c47-a745-eea3d31d418e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:39.663158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc57d-1729-4ae6-995f-6ee27ba7e7c7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:39.700184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:39.716123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ddfa2-33d6-4159-978f-d04ef465382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:39.718042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ddfa2-33d6-4159-978f-d04ef465382d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.719763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ddfa2-33d6-4159-978f-d04ef465382d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.720552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ddfa2-33d6-4159-978f-d04ef465382d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.723166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b24ccd-99c5-48db-84d9-6cf3267ea9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:39.724234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b24ccd-99c5-48db-84d9-6cf3267ea9ac None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.724760 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b24ccd-99c5-48db-84d9-6cf3267ea9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.725283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b24ccd-99c5-48db-84d9-6cf3267ea9ac None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.726847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b24ccd-99c5-48db-84d9-6cf3267ea9ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:39.727458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b24ccd-99c5-48db-84d9-6cf3267ea9ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:39.730514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b24ccd-99c5-48db-84d9-6cf3267ea9ac None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:39.740237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ddfa2-33d6-4159-978f-d04ef465382d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:39.743461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ddfa2-33d6-4159-978f-d04ef465382d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:39.754688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 409/809] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:39.754688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b24ccd-99c5-48db-84d9-6cf3267ea9ac None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ee3ddfa2-33d6-4159-978f-d04ef465382d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:39.776484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:39.778380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:39.780193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:39.780193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:39.780193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:39.780193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:39.780193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:39.780193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:39.780193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:39.780193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:39.784504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 401/810] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:39.786257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ddfa2-33d6-4159-978f-d04ef465382d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:39.840819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:39.928549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b24ccd-99c5-48db-84d9-6cf3267ea9ac None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:39.941077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ddfa2-33d6-4159-978f-d04ef465382d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:39.982511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68056095-34de-488c-87c9-52a0a1b580ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:39.983648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68056095-34de-488c-87c9-52a0a1b580ee None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.983931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68056095-34de-488c-87c9-52a0a1b580ee None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.984461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68056095-34de-488c-87c9-52a0a1b580ee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.985070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68056095-34de-488c-87c9-52a0a1b580ee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:39.986670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68056095-34de-488c-87c9-52a0a1b580ee None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:39.988664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c170b6-8596-4f74-b0ae-475893129bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:39.989387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c170b6-8596-4f74-b0ae-475893129bad None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:39.989879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c170b6-8596-4f74-b0ae-475893129bad None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:39.990191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c170b6-8596-4f74-b0ae-475893129bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-68056095-34de-488c-87c9-52a0a1b580ee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:39.998047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:39.999089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:19:39.999929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:40.000653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 410/811] 10.222.0.78 () {56 vars in 1129 bytes} [Wed Aug 24 03:19:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:40.001152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68056095-34de-488c-87c9-52a0a1b580ee None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:40.010172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c170b6-8596-4f74-b0ae-475893129bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:40.012371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c170b6-8596-4f74-b0ae-475893129bad None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-75c170b6-8596-4f74-b0ae-475893129bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:40.032554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:40.034748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:40.036816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:40.036816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:40.036816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:40.036816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 402/812] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:40.036816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c170b6-8596-4f74-b0ae-475893129bad None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:40.100060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:40.165724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68056095-34de-488c-87c9-52a0a1b580ee None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:40.182096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:40.185686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c170b6-8596-4f74-b0ae-475893129bad None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:40.208366 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070beae-c8b0-4fa6-8e43-cdc600121575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:40.208993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070beae-c8b0-4fa6-8e43-cdc600121575 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:40.209273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070beae-c8b0-4fa6-8e43-cdc600121575 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:40.209546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070beae-c8b0-4fa6-8e43-cdc600121575 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:40.210248 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070beae-c8b0-4fa6-8e43-cdc600121575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:40.210554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070beae-c8b0-4fa6-8e43-cdc600121575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:40.212702 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070beae-c8b0-4fa6-8e43-cdc600121575 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:40.231734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 411/813] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:40.231734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070beae-c8b0-4fa6-8e43-cdc600121575 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:40.233858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a3cd5-7ce2-4343-8c7a-66c72de47ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:40.234828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a3cd5-7ce2-4343-8c7a-66c72de47ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:40.235303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a3cd5-7ce2-4343-8c7a-66c72de47ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:40.235820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a3cd5-7ce2-4343-8c7a-66c72de47ad2 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:40.236679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a3cd5-7ce2-4343-8c7a-66c72de47ad2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:40.237255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a3cd5-7ce2-4343-8c7a-66c72de47ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:40.239577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a3cd5-7ce2-4343-8c7a-66c72de47ad2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:40.245560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 403/814] 10.222.0.78 () {56 vars in 1124 bytes} [Wed Aug 24 03:19:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:40.246779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a3cd5-7ce2-4343-8c7a-66c72de47ad2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:40.347211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070beae-c8b0-4fa6-8e43-cdc600121575 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:40.364725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a3cd5-7ce2-4343-8c7a-66c72de47ad2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:40.373834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:40.387826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5964c-8021-4399-ae3d-c3da48bc1ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:40.388701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5964c-8021-4399-ae3d-c3da48bc1ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:40.389145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5964c-8021-4399-ae3d-c3da48bc1ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:40.389558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5964c-8021-4399-ae3d-c3da48bc1ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:40.390367 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5964c-8021-4399-ae3d-c3da48bc1ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:40.390942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5964c-8021-4399-ae3d-c3da48bc1ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:40.392475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5964c-8021-4399-ae3d-c3da48bc1ca2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:40.406165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 412/815] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:40.407405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5964c-8021-4399-ae3d-c3da48bc1ca2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:40.412410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e076395-7a4a-4e86-b984-722aaf20b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:40.413065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e076395-7a4a-4e86-b984-722aaf20b30c None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:40.413439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e076395-7a4a-4e86-b984-722aaf20b30c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:40.413805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e076395-7a4a-4e86-b984-722aaf20b30c None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/c72dc03535044d6a97a953256839d413/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:40.416751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e076395-7a4a-4e86-b984-722aaf20b30c None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=c72dc03535044d6a97a953256839d413, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:40.418351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e076395-7a4a-4e86-b984-722aaf20b30c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:40.442162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 404/816] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:19:40 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/c72dc03535044d6a97a953256839d413/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:19:40.443228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e076395-7a4a-4e86-b984-722aaf20b30c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:40.451449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:40.537271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5964c-8021-4399-ae3d-c3da48bc1ca2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:40.617992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611db08-2651-4567-9aee-03cf54c66f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:40.618951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611db08-2651-4567-9aee-03cf54c66f61 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:40.619531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611db08-2651-4567-9aee-03cf54c66f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:40.620992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611db08-2651-4567-9aee-03cf54c66f61 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:40.622057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611db08-2651-4567-9aee-03cf54c66f61 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:40.622733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611db08-2651-4567-9aee-03cf54c66f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:40.624335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611db08-2651-4567-9aee-03cf54c66f61 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:40.644500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 413/817] 10.222.0.78 () {56 vars in 1124 bytes} [Wed Aug 24 03:19:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:40.649423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611db08-2651-4567-9aee-03cf54c66f61 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:40.674832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e076395-7a4a-4e86-b984-722aaf20b30c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:40.735740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637e405-763a-490c-bd81-4d933cce91ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:40.736631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637e405-763a-490c-bd81-4d933cce91ec None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:40.737055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637e405-763a-490c-bd81-4d933cce91ec None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:40.737559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637e405-763a-490c-bd81-4d933cce91ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:40.755368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637e405-763a-490c-bd81-4d933cce91ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:40.757017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637e405-763a-490c-bd81-4d933cce91ec None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4637e405-763a-490c-bd81-4d933cce91ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:40.772044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:40.773269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:40.774469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 405/818] 10.222.0.78 () {56 vars in 1093 bytes} [Wed Aug 24 03:19:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:40.781121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637e405-763a-490c-bd81-4d933cce91ec None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:40.814808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:40.817660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:40.826781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611db08-2651-4567-9aee-03cf54c66f61 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:40.899704 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83a62f-1975-4c63-9d8d-c52a9429cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:40.900375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a62f-1975-4c63-9d8d-c52a9429cdd5 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:40.900648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a62f-1975-4c63-9d8d-c52a9429cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:40.900912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a62f-1975-4c63-9d8d-c52a9429cdd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:40.901662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83a62f-1975-4c63-9d8d-c52a9429cdd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:40.903079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83a62f-1975-4c63-9d8d-c52a9429cdd5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:40.948210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 414/819] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:19:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:19:40.949521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f2791-fafb-4925-a693-db34090dab2a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:40.949801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f2791-fafb-4925-a693-db34090dab2a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:40.950069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f2791-fafb-4925-a693-db34090dab2a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:40.951633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 415/820] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:40.960555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16062-77f2-4dfa-9509-db6d8c77064f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:40.960985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16062-77f2-4dfa-9509-db6d8c77064f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:40.961276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16062-77f2-4dfa-9509-db6d8c77064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:40.969174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637e405-763a-490c-bd81-4d933cce91ec None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:40.984487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-91e16062-77f2-4dfa-9509-db6d8c77064f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:40.985812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-91e16062-77f2-4dfa-9509-db6d8c77064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:41.085415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 416/821] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:19:41.104856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843cf36-1e5a-49e9-b1f3-05c113781148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:41.105489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843cf36-1e5a-49e9-b1f3-05c113781148 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:41.105766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843cf36-1e5a-49e9-b1f3-05c113781148 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:41.106029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843cf36-1e5a-49e9-b1f3-05c113781148 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:41.106820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843cf36-1e5a-49e9-b1f3-05c113781148 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:41.107127 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843cf36-1e5a-49e9-b1f3-05c113781148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:41.108597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843cf36-1e5a-49e9-b1f3-05c113781148 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:41.140393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 406/822] 10.222.0.78 () {56 vars in 1133 bytes} [Wed Aug 24 03:19:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:41.147266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16062-77f2-4dfa-9509-db6d8c77064f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:41.263489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:41.305621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16062-77f2-4dfa-9509-db6d8c77064f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:41.368549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0193e-4d1f-495e-a62a-29ef9802de16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:41.369618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0193e-4d1f-495e-a62a-29ef9802de16 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:41.370102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0193e-4d1f-495e-a62a-29ef9802de16 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:41.370572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0193e-4d1f-495e-a62a-29ef9802de16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:41.419172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843cf36-1e5a-49e9-b1f3-05c113781148 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:41.586044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:41.626902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843cf36-1e5a-49e9-b1f3-05c113781148 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:41.648648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0193e-4d1f-495e-a62a-29ef9802de16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:41.650840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0193e-4d1f-495e-a62a-29ef9802de16 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:41.679279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d082e31-a40e-41f0-85cf-8ffbbd1d9f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:41.680229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082e31-a40e-41f0-85cf-8ffbbd1d9f27 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:41.680503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082e31-a40e-41f0-85cf-8ffbbd1d9f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:41.680767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082e31-a40e-41f0-85cf-8ffbbd1d9f27 None admin] PATH_INFO: `/v3/services/network` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:41.681383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d082e31-a40e-41f0-85cf-8ffbbd1d9f27 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:41.683708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d082e31-a40e-41f0-85cf-8ffbbd1d9f27 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-3d082e31-a40e-41f0-85cf-8ffbbd1d9f27 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:41.697051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:41.698482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:19:41.699730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:41.702117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 407/823] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:41 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:41.703717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610659a-6f41-4218-8905-4d03a2d99423 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:41.703990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610659a-6f41-4218-8905-4d03a2d99423 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:41.704255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610659a-6f41-4218-8905-4d03a2d99423 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:41.710127 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 408/824] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:41.710127 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610659a-6f41-4218-8905-4d03a2d99423 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:41.769752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:41.796202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 417/825] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:19:41.797408 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fcb5b-e7b9-4c95-ac8f-fc5a75216911 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:41.797692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fcb5b-e7b9-4c95-ac8f-fc5a75216911 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:41.797974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fcb5b-e7b9-4c95-ac8f-fc5a75216911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:41.818296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-627fcb5b-e7b9-4c95-ac8f-fc5a75216911 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:41.819548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-627fcb5b-e7b9-4c95-ac8f-fc5a75216911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:41.854028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610659a-6f41-4218-8905-4d03a2d99423 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:41.900514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 418/826] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:41.900514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fcb5b-e7b9-4c95-ac8f-fc5a75216911 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:41.906440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0667e6e-734a-4a61-a753-9b78554755f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:41.907541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0667e6e-734a-4a61-a753-9b78554755f7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:41.908022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0667e6e-734a-4a61-a753-9b78554755f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:41.908560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0667e6e-734a-4a61-a753-9b78554755f7 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:41.909741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0667e6e-734a-4a61-a753-9b78554755f7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:41.910283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0667e6e-734a-4a61-a753-9b78554755f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:41.912222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0667e6e-734a-4a61-a753-9b78554755f7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:41.919239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 409/827] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:19:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:41.926251 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0667e6e-734a-4a61-a753-9b78554755f7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:41.958253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:42.138871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0667e6e-734a-4a61-a753-9b78554755f7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:42.173089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fcb5b-e7b9-4c95-ac8f-fc5a75216911 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:42.193807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:42.208036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59febdbc-c93f-44b6-abc3-dddf63d921e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:42.209515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59febdbc-c93f-44b6-abc3-dddf63d921e7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:42.210196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59febdbc-c93f-44b6-abc3-dddf63d921e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:42.211739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59febdbc-c93f-44b6-abc3-dddf63d921e7 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:42.213471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59febdbc-c93f-44b6-abc3-dddf63d921e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:42.214615 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59febdbc-c93f-44b6-abc3-dddf63d921e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:42.219600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59febdbc-c93f-44b6-abc3-dddf63d921e7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:42.231495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a574e-5f51-402d-abb4-22a56782a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:42.232157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a574e-5f51-402d-abb4-22a56782a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:42.232445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a574e-5f51-402d-abb4-22a56782a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:42.232717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a574e-5f51-402d-abb4-22a56782a7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:42.234157 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 410/828] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:19:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:42.236420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59febdbc-c93f-44b6-abc3-dddf63d921e7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:42.251161 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a574e-5f51-402d-abb4-22a56782a7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:42.253488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a574e-5f51-402d-abb4-22a56782a7f6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8f0a574e-5f51-402d-abb4-22a56782a7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:42.273071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:42.275959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:42.277525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:42.277525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:42.277525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:42.277525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 419/829] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:42.277525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a574e-5f51-402d-abb4-22a56782a7f6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:42.362687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:42.407190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59febdbc-c93f-44b6-abc3-dddf63d921e7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:42.412329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a574e-5f51-402d-abb4-22a56782a7f6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:42.454322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacbc85-19fe-4721-a7d0-2160b09a8d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:42.455850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacbc85-19fe-4721-a7d0-2160b09a8d1b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:42.456356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacbc85-19fe-4721-a7d0-2160b09a8d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:42.457121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacbc85-19fe-4721-a7d0-2160b09a8d1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:42.460763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d041e7-94d2-495c-acb6-f5a159583c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:42.461597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d041e7-94d2-495c-acb6-f5a159583c98 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:42.462039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d041e7-94d2-495c-acb6-f5a159583c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:42.462477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d041e7-94d2-495c-acb6-f5a159583c98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:42.463506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d041e7-94d2-495c-acb6-f5a159583c98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:42.465310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d041e7-94d2-495c-acb6-f5a159583c98 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:42.469801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacbc85-19fe-4721-a7d0-2160b09a8d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-cdacbc85-19fe-4721-a7d0-2160b09a8d1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:42.479265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:42.480291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:19:42.481200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:42.483443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 411/830] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:42.483443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacbc85-19fe-4721-a7d0-2160b09a8d1b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:42.498755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 420/831] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:19:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:19:42.500263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d041e7-94d2-495c-acb6-f5a159583c98 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:42.549523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:42.669004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d041e7-94d2-495c-acb6-f5a159583c98 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:42.722720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42431bb-5019-44a5-b782-ca21e39dad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:42.723551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42431bb-5019-44a5-b782-ca21e39dad01 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:42.723831 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42431bb-5019-44a5-b782-ca21e39dad01 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:42.724101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42431bb-5019-44a5-b782-ca21e39dad01 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:42.724808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42431bb-5019-44a5-b782-ca21e39dad01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:42.725116 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42431bb-5019-44a5-b782-ca21e39dad01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:42.727300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42431bb-5019-44a5-b782-ca21e39dad01 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:42.743683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 421/832] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:42.749398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42431bb-5019-44a5-b782-ca21e39dad01 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:42.751414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacbc85-19fe-4721-a7d0-2160b09a8d1b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:42.801837 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:42.805445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad60f0-640b-485b-948a-c3bc2f2d1611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:42.807268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad60f0-640b-485b-948a-c3bc2f2d1611 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:42.807924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad60f0-640b-485b-948a-c3bc2f2d1611 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:42.808407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad60f0-640b-485b-948a-c3bc2f2d1611 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:42.809429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad60f0-640b-485b-948a-c3bc2f2d1611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:42.809806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad60f0-640b-485b-948a-c3bc2f2d1611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:42.811978 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad60f0-640b-485b-948a-c3bc2f2d1611 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:42.829906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 412/833] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:42.829906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde157-5680-4259-a3eb-db9e604f07b1 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:42.829906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde157-5680-4259-a3eb-db9e604f07b1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:42.829906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde157-5680-4259-a3eb-db9e604f07b1 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:42.830981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 413/834] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:42.832886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcde157-5680-4259-a3eb-db9e604f07b1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:42.854551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:42.883074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42431bb-5019-44a5-b782-ca21e39dad01 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:42.923591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afc53d-e3d8-4fa2-99b3-d2386ad6590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:42.924137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afc53d-e3d8-4fa2-99b3-d2386ad6590a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:42.924403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afc53d-e3d8-4fa2-99b3-d2386ad6590a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:42.924669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afc53d-e3d8-4fa2-99b3-d2386ad6590a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:42.936715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afc53d-e3d8-4fa2-99b3-d2386ad6590a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:42.938255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afc53d-e3d8-4fa2-99b3-d2386ad6590a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d4afc53d-e3d8-4fa2-99b3-d2386ad6590a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:42.954087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:42.960581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:42.961525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:42.961525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:42.961525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:42.961722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcde157-5680-4259-a3eb-db9e604f07b1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:42.961808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 422/835] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:42.961808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc9cc4-6091-46cd-8aa0-53e0790f50f7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:42.961808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc9cc4-6091-46cd-8aa0-53e0790f50f7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:42.961808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc9cc4-6091-46cd-8aa0-53e0790f50f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:42.985584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-15fc9cc4-6091-46cd-8aa0-53e0790f50f7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:42.987104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-15fc9cc4-6091-46cd-8aa0-53e0790f50f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:43.009080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d09e-97dc-421b-8455-b186ea7d0d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:43.009724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d09e-97dc-421b-8455-b186ea7d0d7f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.009999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d09e-97dc-421b-8455-b186ea7d0d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.010266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d09e-97dc-421b-8455-b186ea7d0d7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.017982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52d09e-97dc-421b-8455-b186ea7d0d7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:43.019568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52d09e-97dc-421b-8455-b186ea7d0d7f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ef52d09e-97dc-421b-8455-b186ea7d0d7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:43.031245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:43.032274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 414/836] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:43.033216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d09e-97dc-421b-8455-b186ea7d0d7f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:43.074633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 423/837] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:43.075581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc9cc4-6091-46cd-8aa0-53e0790f50f7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:43.117916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:43.157910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:43.172832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d09e-97dc-421b-8455-b186ea7d0d7f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:43.210639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc9cc4-6091-46cd-8aa0-53e0790f50f7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:43.214792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da476adc-0bac-4345-9499-eeb9920d6c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:43.215428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476adc-0bac-4345-9499-eeb9920d6c2c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.215709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476adc-0bac-4345-9499-eeb9920d6c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.216081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476adc-0bac-4345-9499-eeb9920d6c2c None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.216749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da476adc-0bac-4345-9499-eeb9920d6c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:43.217057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da476adc-0bac-4345-9499-eeb9920d6c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:43.218451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da476adc-0bac-4345-9499-eeb9920d6c2c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:43.236465 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 415/838] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:43.237798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da476adc-0bac-4345-9499-eeb9920d6c2c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:43.261328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6510695-06aa-40b5-97c4-a9c476bbf14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:43.262076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6510695-06aa-40b5-97c4-a9c476bbf14b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.262357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6510695-06aa-40b5-97c4-a9c476bbf14b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.262627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6510695-06aa-40b5-97c4-a9c476bbf14b None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.263732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6510695-06aa-40b5-97c4-a9c476bbf14b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:43.264044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6510695-06aa-40b5-97c4-a9c476bbf14b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:43.265530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6510695-06aa-40b5-97c4-a9c476bbf14b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:43.286689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 424/839] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:43.289351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6510695-06aa-40b5-97c4-a9c476bbf14b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:43.360319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da476adc-0bac-4345-9499-eeb9920d6c2c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:43.374586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:43.397707 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66868ea0-77e7-46c6-98d7-861468fc85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:43.398336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66868ea0-77e7-46c6-98d7-861468fc85b5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.398605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66868ea0-77e7-46c6-98d7-861468fc85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.398897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66868ea0-77e7-46c6-98d7-861468fc85b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.406387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66868ea0-77e7-46c6-98d7-861468fc85b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:43.407876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66868ea0-77e7-46c6-98d7-861468fc85b5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:43.411652 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6510695-06aa-40b5-97c4-a9c476bbf14b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-66868ea0-77e7-46c6-98d7-861468fc85b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:43.421203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:43.422317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 416/840] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:19:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:43.423698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66868ea0-77e7-46c6-98d7-861468fc85b5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:43.432497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:43.452275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4ceb7-91b4-4f84-b37a-0d249eeac429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:43.452925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4ceb7-91b4-4f84-b37a-0d249eeac429 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.453196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4ceb7-91b4-4f84-b37a-0d249eeac429 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.453469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4ceb7-91b4-4f84-b37a-0d249eeac429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.454343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4ceb7-91b4-4f84-b37a-0d249eeac429 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=438786dead414066a6ef101a2493fb8c) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:43.454641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4ceb7-91b4-4f84-b37a-0d249eeac429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:43.456157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4ceb7-91b4-4f84-b37a-0d249eeac429 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:43.462524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 425/841] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:43 2022] GET /identity/v3/role_assignments?user.id=438786dead414066a6ef101a2493fb8c&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:43.463711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04a623-848d-483f-a67f-2db19fbb62d6 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.463999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04a623-848d-483f-a67f-2db19fbb62d6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.464273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04a623-848d-483f-a67f-2db19fbb62d6 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.465836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 426/842] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:43.466307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04a623-848d-483f-a67f-2db19fbb62d6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:43.545886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66868ea0-77e7-46c6-98d7-861468fc85b5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:43.604133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554fb0b-e967-48f3-92f5-a5d9b7164c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:43.604755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554fb0b-e967-48f3-92f5-a5d9b7164c1b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.605062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554fb0b-e967-48f3-92f5-a5d9b7164c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.605295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554fb0b-e967-48f3-92f5-a5d9b7164c1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.621193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554fb0b-e967-48f3-92f5-a5d9b7164c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:43.626056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04a623-848d-483f-a67f-2db19fbb62d6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-5554fb0b-e967-48f3-92f5-a5d9b7164c1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:43.626749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:43.628310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 417/843] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:43.630315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431547-3a8f-41ac-a38f-15e1a9e3c93b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.631150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431547-3a8f-41ac-a38f-15e1a9e3c93b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.631150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431547-3a8f-41ac-a38f-15e1a9e3c93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.653223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fd431547-3a8f-41ac-a38f-15e1a9e3c93b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:43.653702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fd431547-3a8f-41ac-a38f-15e1a9e3c93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:43.686996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:43.692321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc846240-9da5-48e4-adb7-ad0e627f575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:43.693179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc846240-9da5-48e4-adb7-ad0e627f575c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.693460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc846240-9da5-48e4-adb7-ad0e627f575c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.693733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc846240-9da5-48e4-adb7-ad0e627f575c None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.694487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc846240-9da5-48e4-adb7-ad0e627f575c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:43.694827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc846240-9da5-48e4-adb7-ad0e627f575c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:43.696276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc846240-9da5-48e4-adb7-ad0e627f575c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:43.721974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 427/844] 10.222.0.78 () {56 vars in 1149 bytes} [Wed Aug 24 03:19:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:43.721974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc846240-9da5-48e4-adb7-ad0e627f575c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:43.753346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 418/845] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:43.761003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd431547-3a8f-41ac-a38f-15e1a9e3c93b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:43.776126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:43.884356 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc846240-9da5-48e4-adb7-ad0e627f575c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:43.942054 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd7089-3900-43ec-b0bf-8a72986f9d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:43.943058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd7089-3900-43ec-b0bf-8a72986f9d15 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:43.943525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd7089-3900-43ec-b0bf-8a72986f9d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:43.943990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd7089-3900-43ec-b0bf-8a72986f9d15 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:43.945114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd7089-3900-43ec-b0bf-8a72986f9d15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:43.945772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd7089-3900-43ec-b0bf-8a72986f9d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:43.948425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd7089-3900-43ec-b0bf-8a72986f9d15 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:43.968675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 428/846] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:19:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:43.970044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd7089-3900-43ec-b0bf-8a72986f9d15 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:43.987028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd431547-3a8f-41ac-a38f-15e1a9e3c93b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:44.033339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143eabea-1e7f-4bb9-a4ed-29ab24e94290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:44.033964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143eabea-1e7f-4bb9-a4ed-29ab24e94290 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:44.034296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143eabea-1e7f-4bb9-a4ed-29ab24e94290 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:44.034553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143eabea-1e7f-4bb9-a4ed-29ab24e94290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:44.067326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:44.088637 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:44.093522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd7089-3900-43ec-b0bf-8a72986f9d15 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:44.109449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143eabea-1e7f-4bb9-a4ed-29ab24e94290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:44.110948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143eabea-1e7f-4bb9-a4ed-29ab24e94290 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:44.144658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb5531-0a55-45f8-a98d-54720597f6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:44.145326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb5531-0a55-45f8-a98d-54720597f6fb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:44.145604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb5531-0a55-45f8-a98d-54720597f6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:44.145874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb5531-0a55-45f8-a98d-54720597f6fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:44.165431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb5531-0a55-45f8-a98d-54720597f6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:44.167415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb5531-0a55-45f8-a98d-54720597f6fb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-50fb5531-0a55-45f8-a98d-54720597f6fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:44.191045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:44.192893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:44.195669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:44.195669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:44.195669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:44.195669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 429/847] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:44.195669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb5531-0a55-45f8-a98d-54720597f6fb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:44.292504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 419/848] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:19:44.294418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143eabea-1e7f-4bb9-a4ed-29ab24e94290 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:44.350208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb5531-0a55-45f8-a98d-54720597f6fb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:44.390310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe295b-ec30-4427-a56e-180cdb508681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:44.391098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe295b-ec30-4427-a56e-180cdb508681 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:44.391444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe295b-ec30-4427-a56e-180cdb508681 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:44.391792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe295b-ec30-4427-a56e-180cdb508681 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:44.392516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe295b-ec30-4427-a56e-180cdb508681 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:44.393931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe295b-ec30-4427-a56e-180cdb508681 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:44.396143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3fbe295b-ec30-4427-a56e-180cdb508681 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:44.404462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:44.405721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:19:44.407064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:44.410863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 430/849] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:19:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:44.411779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe295b-ec30-4427-a56e-180cdb508681 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:44.434825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:44.479031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143eabea-1e7f-4bb9-a4ed-29ab24e94290 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:44.537395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9371a26-6b4d-4dd7-8af5-1d89258a7064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:44.538461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9371a26-6b4d-4dd7-8af5-1d89258a7064 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:44.539006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9371a26-6b4d-4dd7-8af5-1d89258a7064 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:44.539479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9371a26-6b4d-4dd7-8af5-1d89258a7064 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:44.540642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9371a26-6b4d-4dd7-8af5-1d89258a7064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:44.541146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9371a26-6b4d-4dd7-8af5-1d89258a7064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:44.543062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9371a26-6b4d-4dd7-8af5-1d89258a7064 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:44.548020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe295b-ec30-4427-a56e-180cdb508681 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:44.558078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 420/850] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:44.558949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9371a26-6b4d-4dd7-8af5-1d89258a7064 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:44.604002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff00f59-2baa-4b5a-a3f5-c3c671669f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:44.605045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff00f59-2baa-4b5a-a3f5-c3c671669f03 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:44.606152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff00f59-2baa-4b5a-a3f5-c3c671669f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:44.606152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff00f59-2baa-4b5a-a3f5-c3c671669f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:44.625835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff00f59-2baa-4b5a-a3f5-c3c671669f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:44.628808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff00f59-2baa-4b5a-a3f5-c3c671669f03 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7ff00f59-2baa-4b5a-a3f5-c3c671669f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:44.658014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:44.659503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:44.660658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:44.660658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:44.660658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:44.667032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 431/851] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:44.668242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff00f59-2baa-4b5a-a3f5-c3c671669f03 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:44.705653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9371a26-6b4d-4dd7-8af5-1d89258a7064 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:44.737363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:44.743571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:44.754914 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23f1a7-8c7b-4efe-9d69-9614114e93d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:44.755904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23f1a7-8c7b-4efe-9d69-9614114e93d3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:44.756188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23f1a7-8c7b-4efe-9d69-9614114e93d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:44.756458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23f1a7-8c7b-4efe-9d69-9614114e93d3 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:44.757422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23f1a7-8c7b-4efe-9d69-9614114e93d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:44.757889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23f1a7-8c7b-4efe-9d69-9614114e93d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:44.759335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23f1a7-8c7b-4efe-9d69-9614114e93d3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:44.770715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 421/852] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:19:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:44.771681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23f1a7-8c7b-4efe-9d69-9614114e93d3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:44.794061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff00f59-2baa-4b5a-a3f5-c3c671669f03 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:44.853809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48108ad0-7e9b-4710-8ab8-9593fe8e4e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:44.854864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48108ad0-7e9b-4710-8ab8-9593fe8e4e85 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:44.855339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48108ad0-7e9b-4710-8ab8-9593fe8e4e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:44.855838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48108ad0-7e9b-4710-8ab8-9593fe8e4e85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:44.867906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48108ad0-7e9b-4710-8ab8-9593fe8e4e85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:44.869397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48108ad0-7e9b-4710-8ab8-9593fe8e4e85 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-48108ad0-7e9b-4710-8ab8-9593fe8e4e85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:44.882880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:44.883941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 432/853] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:19:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:44.884929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48108ad0-7e9b-4710-8ab8-9593fe8e4e85 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:44.927874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23f1a7-8c7b-4efe-9d69-9614114e93d3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:44.968101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec413e21-a211-4e87-a766-1a40a725d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:44.968724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec413e21-a211-4e87-a766-1a40a725d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:44.969005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec413e21-a211-4e87-a766-1a40a725d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:44.969273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec413e21-a211-4e87-a766-1a40a725d7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:44.969933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec413e21-a211-4e87-a766-1a40a725d7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:44.970232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec413e21-a211-4e87-a766-1a40a725d7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:44.972087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec413e21-a211-4e87-a766-1a40a725d7d7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:44.984426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 422/854] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:44.985320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec413e21-a211-4e87-a766-1a40a725d7d7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:45.045384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48108ad0-7e9b-4710-8ab8-9593fe8e4e85 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:45.061835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:45.092262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:45.105489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c21bbe-2c3c-4024-8de9-3e903aae750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:45.106427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c21bbe-2c3c-4024-8de9-3e903aae750b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:45.106917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c21bbe-2c3c-4024-8de9-3e903aae750b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:45.107358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c21bbe-2c3c-4024-8de9-3e903aae750b None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:45.108387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c21bbe-2c3c-4024-8de9-3e903aae750b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:45.108873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c21bbe-2c3c-4024-8de9-3e903aae750b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:45.111168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c21bbe-2c3c-4024-8de9-3e903aae750b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:45.130694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 433/855] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:19:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:45.130694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c21bbe-2c3c-4024-8de9-3e903aae750b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:45.162348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec413e21-a211-4e87-a766-1a40a725d7d7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:45.227965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9048ff4-7793-4f2a-94a9-34572a7d5a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:45.228784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048ff4-7793-4f2a-94a9-34572a7d5a97 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:45.229337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048ff4-7793-4f2a-94a9-34572a7d5a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:45.229829 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048ff4-7793-4f2a-94a9-34572a7d5a97 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:45.231123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9048ff4-7793-4f2a-94a9-34572a7d5a97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:45.231511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9048ff4-7793-4f2a-94a9-34572a7d5a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:45.233383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9048ff4-7793-4f2a-94a9-34572a7d5a97 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:45.263176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 423/856] 10.222.0.78 () {56 vars in 1135 bytes} [Wed Aug 24 03:19:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:45.271493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9048ff4-7793-4f2a-94a9-34572a7d5a97 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:45.299795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c21bbe-2c3c-4024-8de9-3e903aae750b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:45.354049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76f9c7-afd5-448d-ac47-ac4d4ba99d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:45.356271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f9c7-afd5-448d-ac47-ac4d4ba99d7c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:45.356928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f9c7-afd5-448d-ac47-ac4d4ba99d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:45.357580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76f9c7-afd5-448d-ac47-ac4d4ba99d7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:45.372150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76f9c7-afd5-448d-ac47-ac4d4ba99d7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:45.373948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76f9c7-afd5-448d-ac47-ac4d4ba99d7c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ad76f9c7-afd5-448d-ac47-ac4d4ba99d7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:45.391751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:45.392812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:45.393806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:45.393806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:45.393806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:45.393806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:45.393806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:45.393806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:45.393806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:45.393806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:45.393806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 434/857] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:45.403003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76f9c7-afd5-448d-ac47-ac4d4ba99d7c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:45.464642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9048ff4-7793-4f2a-94a9-34572a7d5a97 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:45.470043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:45.496445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:45.531774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64337c-bee2-4539-b8cc-246a8b40d164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:45.532734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64337c-bee2-4539-b8cc-246a8b40d164 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:45.533172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64337c-bee2-4539-b8cc-246a8b40d164 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:45.533602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64337c-bee2-4539-b8cc-246a8b40d164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:45.586930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76f9c7-afd5-448d-ac47-ac4d4ba99d7c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:45.638820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86edd0-9eb7-451c-a5e0-7f4f7b78f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:45.639609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86edd0-9eb7-451c-a5e0-7f4f7b78f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:45.639962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86edd0-9eb7-451c-a5e0-7f4f7b78f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:45.640308 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86edd0-9eb7-451c-a5e0-7f4f7b78f7c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:45.641108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86edd0-9eb7-451c-a5e0-7f4f7b78f7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:45.641494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86edd0-9eb7-451c-a5e0-7f4f7b78f7c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:45.643304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86edd0-9eb7-451c-a5e0-7f4f7b78f7c1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:45.659099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 435/858] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:45.660674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeea0e-a6cb-4d0f-96fb-16bfde46473d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:45.661053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeea0e-a6cb-4d0f-96fb-16bfde46473d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:45.661424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeea0e-a6cb-4d0f-96fb-16bfde46473d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:45.667250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 436/859] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:45.667587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeea0e-a6cb-4d0f-96fb-16bfde46473d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:45.669409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64337c-bee2-4539-b8cc-246a8b40d164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:45.671050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64337c-bee2-4539-b8cc-246a8b40d164 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:45.798605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 424/860] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:19:45.799944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2081b-81a1-4614-beac-8586263b1671 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:45.800935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2081b-81a1-4614-beac-8586263b1671 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:45.801276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2081b-81a1-4614-beac-8586263b1671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:45.807354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeea0e-a6cb-4d0f-96fb-16bfde46473d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:45.810268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:45.824668 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d2b2081b-81a1-4614-beac-8586263b1671 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:45.825831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d2b2081b-81a1-4614-beac-8586263b1671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:45.827890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:45.857576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc4272-c7e9-4815-8b46-e0972f054d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:45.857800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc4272-c7e9-4815-8b46-e0972f054d04 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:45.858154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc4272-c7e9-4815-8b46-e0972f054d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:45.858547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc4272-c7e9-4815-8b46-e0972f054d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:45.859259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc4272-c7e9-4815-8b46-e0972f054d04 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=f988895119ea43448a4a0f4e4a0274bd) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:45.859565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc4272-c7e9-4815-8b46-e0972f054d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:45.861086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc4272-c7e9-4815-8b46-e0972f054d04 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:45.875172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 437/861] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:45 2022] GET /identity/v3/role_assignments?user.id=f988895119ea43448a4a0f4e4a0274bd&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:45.876091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc4272-c7e9-4815-8b46-e0972f054d04 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:45.918025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 425/862] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:46.013396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc4272-c7e9-4815-8b46-e0972f054d04 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:46.052630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56a107-02ef-46c8-bffa-578945595db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:46.053573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56a107-02ef-46c8-bffa-578945595db9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:46.054010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56a107-02ef-46c8-bffa-578945595db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:46.054430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56a107-02ef-46c8-bffa-578945595db9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:46.066361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56a107-02ef-46c8-bffa-578945595db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:46.068202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56a107-02ef-46c8-bffa-578945595db9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-fb56a107-02ef-46c8-bffa-578945595db9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:46.084695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:46.085789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:46.086813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:46.086813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:46.086813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:46.088503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 438/863] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:46.094306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2081b-81a1-4614-beac-8586263b1671 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:46.199618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56a107-02ef-46c8-bffa-578945595db9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:46.232860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:46.263093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2081b-81a1-4614-beac-8586263b1671 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:46.304667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce127c-b7a2-4347-83b2-64ac0dca6169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:46.305742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce127c-b7a2-4347-83b2-64ac0dca6169 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:46.306298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce127c-b7a2-4347-83b2-64ac0dca6169 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:46.307046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce127c-b7a2-4347-83b2-64ac0dca6169 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:46.308453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce127c-b7a2-4347-83b2-64ac0dca6169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:46.309284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce127c-b7a2-4347-83b2-64ac0dca6169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:46.311532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce127c-b7a2-4347-83b2-64ac0dca6169 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:46.313547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:46.326390 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56a107-02ef-46c8-bffa-578945595db9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:46.327970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 426/864] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:46.334563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce127c-b7a2-4347-83b2-64ac0dca6169 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:46.367886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23461ca5-9707-41c8-b09f-abd7cef7e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:46.368470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23461ca5-9707-41c8-b09f-abd7cef7e52b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:46.368751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23461ca5-9707-41c8-b09f-abd7cef7e52b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:46.369025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23461ca5-9707-41c8-b09f-abd7cef7e52b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:46.369622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23461ca5-9707-41c8-b09f-abd7cef7e52b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:46.371033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23461ca5-9707-41c8-b09f-abd7cef7e52b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-23461ca5-9707-41c8-b09f-abd7cef7e52b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:46.380339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:46.381362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:46.387703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 439/865] 10.222.0.78 () {56 vars in 1132 bytes} [Wed Aug 24 03:19:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:46.388881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23461ca5-9707-41c8-b09f-abd7cef7e52b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:46.460986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce127c-b7a2-4347-83b2-64ac0dca6169 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:46.496278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:46.503583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e8ba0-0547-4e87-9bfd-4e0e0539ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:46.504392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e8ba0-0547-4e87-9bfd-4e0e0539ecac None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:46.504768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e8ba0-0547-4e87-9bfd-4e0e0539ecac None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:46.505128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e8ba0-0547-4e87-9bfd-4e0e0539ecac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:46.507324 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23461ca5-9707-41c8-b09f-abd7cef7e52b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:46.512988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e8ba0-0547-4e87-9bfd-4e0e0539ecac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:46.514529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e8ba0-0547-4e87-9bfd-4e0e0539ecac None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-488e8ba0-0547-4e87-9bfd-4e0e0539ecac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:46.527113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:46.528151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:46.529041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:46.529041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:46.529041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:46.529041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:46.529041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:46.529041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:46.529041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:46.529041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:46.533783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 427/866] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:46.535326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e8ba0-0547-4e87-9bfd-4e0e0539ecac None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:46.547357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0d27-49bf-4a08-b3a5-84904f69e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:46.548275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0d27-49bf-4a08-b3a5-84904f69e69a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:46.548732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0d27-49bf-4a08-b3a5-84904f69e69a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:46.549224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0d27-49bf-4a08-b3a5-84904f69e69a None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:46.549904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0d27-49bf-4a08-b3a5-84904f69e69a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:46.550210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0d27-49bf-4a08-b3a5-84904f69e69a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:46.551788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0d27-49bf-4a08-b3a5-84904f69e69a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:46.561152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 440/867] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:19:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:46.563335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0d27-49bf-4a08-b3a5-84904f69e69a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:46.626899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:46.679749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0d27-49bf-4a08-b3a5-84904f69e69a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:46.689777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e8ba0-0547-4e87-9bfd-4e0e0539ecac None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:46.722009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e828a-38cc-4b3d-ba03-4cade966a792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:46.722530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e828a-38cc-4b3d-ba03-4cade966a792 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:46.722882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e828a-38cc-4b3d-ba03-4cade966a792 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:46.723154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e828a-38cc-4b3d-ba03-4cade966a792 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:46.724114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e828a-38cc-4b3d-ba03-4cade966a792 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:46.724674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e828a-38cc-4b3d-ba03-4cade966a792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:46.726222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e828a-38cc-4b3d-ba03-4cade966a792 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:46.731163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b831cca-2830-4ba6-8be0-63cef00ddf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:46.731778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831cca-2830-4ba6-8be0-63cef00ddf53 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:46.732047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831cca-2830-4ba6-8be0-63cef00ddf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:46.732162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 441/868] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:19:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:46.732322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831cca-2830-4ba6-8be0-63cef00ddf53 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:46.733026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b831cca-2830-4ba6-8be0-63cef00ddf53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:46.733329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b831cca-2830-4ba6-8be0-63cef00ddf53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:46.738952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b831cca-2830-4ba6-8be0-63cef00ddf53 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:46.753199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 428/869] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:46.759408 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e828a-38cc-4b3d-ba03-4cade966a792 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:46.786703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:46.886497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e828a-38cc-4b3d-ba03-4cade966a792 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:46.933270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd0137-5e6d-463e-a547-739533c17c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:46.933886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd0137-5e6d-463e-a547-739533c17c96 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:46.934160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd0137-5e6d-463e-a547-739533c17c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:46.934430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd0137-5e6d-463e-a547-739533c17c96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:46.935193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd0137-5e6d-463e-a547-739533c17c96 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=c72dc03535044d6a97a953256839d413) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:46.935547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd0137-5e6d-463e-a547-739533c17c96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:46.937211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd0137-5e6d-463e-a547-739533c17c96 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:46.944743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 442/870] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:46 2022] GET /identity/v3/role_assignments?user.id=c72dc03535044d6a97a953256839d413&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:47.275222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a27a1-1ac5-458e-b403-f06443659068 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:47.275505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a27a1-1ac5-458e-b403-f06443659068 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:47.275778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a27a1-1ac5-458e-b403-f06443659068 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:47.277370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 429/871] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:47.283073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bebedb-f4a6-416d-8e3e-71a7aff8016a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:47.283362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bebedb-f4a6-416d-8e3e-71a7aff8016a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:47.283645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bebedb-f4a6-416d-8e3e-71a7aff8016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:47.305289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-74bebedb-f4a6-416d-8e3e-71a7aff8016a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:47.306508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-74bebedb-f4a6-416d-8e3e-71a7aff8016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:47.402057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 443/872] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:19:47.672150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a27a1-1ac5-458e-b403-f06443659068 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:47.783862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a27a1-1ac5-458e-b403-f06443659068 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:47.799538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:47.821824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc519ae-0491-4995-aeca-a65de4958cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:47.822820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc519ae-0491-4995-aeca-a65de4958cc7 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:47.823104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc519ae-0491-4995-aeca-a65de4958cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:47.823374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc519ae-0491-4995-aeca-a65de4958cc7 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:47.824048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc519ae-0491-4995-aeca-a65de4958cc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:47.825426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc519ae-0491-4995-aeca-a65de4958cc7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:47.843011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 430/873] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:19:47 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:19:48.064439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5918e2-d6b4-4bf2-8fa1-6aead85c08fe None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:48.064794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5918e2-d6b4-4bf2-8fa1-6aead85c08fe None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:48.065019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5918e2-d6b4-4bf2-8fa1-6aead85c08fe None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:48.066671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 444/874] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:48.072221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931104a1-34f2-4e25-be48-a26663feebe3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:48.072872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931104a1-34f2-4e25-be48-a26663feebe3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:48.073133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931104a1-34f2-4e25-be48-a26663feebe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:48.091814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-931104a1-34f2-4e25-be48-a26663feebe3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:48.092999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-931104a1-34f2-4e25-be48-a26663feebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:48.170284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 431/875] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:48 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:19:48.459324 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5918e2-d6b4-4bf2-8fa1-6aead85c08fe None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:48.477167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:48.575084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5918e2-d6b4-4bf2-8fa1-6aead85c08fe None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:48.619779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ee299-b38d-4aa2-8373-672cea6c0337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:48.620424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ee299-b38d-4aa2-8373-672cea6c0337 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:48.620700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ee299-b38d-4aa2-8373-672cea6c0337 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:48.620966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ee299-b38d-4aa2-8373-672cea6c0337 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:48.632617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ee299-b38d-4aa2-8373-672cea6c0337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-277ee299-b38d-4aa2-8373-672cea6c0337 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:48.637449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:48.638349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:19:48.639202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:48.643022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 445/876] 10.222.0.78 () {56 vars in 1120 bytes} [Wed Aug 24 03:19:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:48.647763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931104a1-34f2-4e25-be48-a26663feebe3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:48.748214 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:48.751631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931104a1-34f2-4e25-be48-a26663feebe3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:48.752554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938f2d-ac08-498c-b863-ba55a9ef5482 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:48.753120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938f2d-ac08-498c-b863-ba55a9ef5482 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:48.753305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938f2d-ac08-498c-b863-ba55a9ef5482 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:48.755630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 446/877] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:48.760428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182ae8a-c79e-45d0-9803-1babebcd7dca None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:48.760707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182ae8a-c79e-45d0-9803-1babebcd7dca None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:48.760977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182ae8a-c79e-45d0-9803-1babebcd7dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:48.779998 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8182ae8a-c79e-45d0-9803-1babebcd7dca None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:48.781204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8182ae8a-c79e-45d0-9803-1babebcd7dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:48.792152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b66e3b-f06f-4d0b-b39f-71ee39566b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:48.793077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b66e3b-f06f-4d0b-b39f-71ee39566b9c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:48.793077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b66e3b-f06f-4d0b-b39f-71ee39566b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:48.793358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b66e3b-f06f-4d0b-b39f-71ee39566b9c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:48.794034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b66e3b-f06f-4d0b-b39f-71ee39566b9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:48.794334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b66e3b-f06f-4d0b-b39f-71ee39566b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:48.795905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b66e3b-f06f-4d0b-b39f-71ee39566b9c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:48.805124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 432/878] 10.222.0.78 () {56 vars in 1115 bytes} [Wed Aug 24 03:19:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:48.811217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b66e3b-f06f-4d0b-b39f-71ee39566b9c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:48.875409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 447/879] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:48 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:19:48.921781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b66e3b-f06f-4d0b-b39f-71ee39566b9c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:48.958770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b99c64-12aa-4f9c-ae82-4f74bdbdd9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:48.959802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b99c64-12aa-4f9c-ae82-4f74bdbdd9dd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:48.960279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b99c64-12aa-4f9c-ae82-4f74bdbdd9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:48.960765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b99c64-12aa-4f9c-ae82-4f74bdbdd9dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:48.973304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b99c64-12aa-4f9c-ae82-4f74bdbdd9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:48.975154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b99c64-12aa-4f9c-ae82-4f74bdbdd9dd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-d1b99c64-12aa-4f9c-ae82-4f74bdbdd9dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:48.991142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:48.992126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:48.993035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:48.993035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:48.993035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:48.995175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 433/880] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:49.002973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182ae8a-c79e-45d0-9803-1babebcd7dca None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:49.005157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:49.113278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cf1bb-6d07-4c54-a611-c927b01108e0 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.113640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cf1bb-6d07-4c54-a611-c927b01108e0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.113832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cf1bb-6d07-4c54-a611-c927b01108e0 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.115490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 434/881] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:49.116399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182ae8a-c79e-45d0-9803-1babebcd7dca None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:49.120798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c75bf4-b5d3-46ac-9598-7a18a75dfb9e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.121077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c75bf4-b5d3-46ac-9598-7a18a75dfb9e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.121350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c75bf4-b5d3-46ac-9598-7a18a75dfb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.140073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a8c75bf4-b5d3-46ac-9598-7a18a75dfb9e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:49.141597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a8c75bf4-b5d3-46ac-9598-7a18a75dfb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:49.152244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:49.159677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0e56f-2193-4333-a52a-1b56a0c80ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:49.160302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0e56f-2193-4333-a52a-1b56a0c80ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.160591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0e56f-2193-4333-a52a-1b56a0c80ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.160843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0e56f-2193-4333-a52a-1b56a0c80ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.161497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0e56f-2193-4333-a52a-1b56a0c80ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:49.161798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0e56f-2193-4333-a52a-1b56a0c80ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:49.163213 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0e56f-2193-4333-a52a-1b56a0c80ff0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:49.176025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 448/882] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:49.176833 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0e56f-2193-4333-a52a-1b56a0c80ff0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:49.230822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 435/883] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:49 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:19:49.232112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c75bf4-b5d3-46ac-9598-7a18a75dfb9e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:49.248400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:49.289675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0e56f-2193-4333-a52a-1b56a0c80ff0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:49.326737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452affe-5dda-41c0-b9fd-fb09bae35ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:49.327461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452affe-5dda-41c0-b9fd-fb09bae35ddd None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.327811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452affe-5dda-41c0-b9fd-fb09bae35ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.328150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452affe-5dda-41c0-b9fd-fb09bae35ddd None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.332815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452affe-5dda-41c0-b9fd-fb09bae35ddd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:49.332815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452affe-5dda-41c0-b9fd-fb09bae35ddd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:49.350639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c75bf4-b5d3-46ac-9598-7a18a75dfb9e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:49.362858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 449/884] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:19:49 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:19:49.403791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70e535-54c1-4d42-bcb6-8f90745dff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:49.404446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70e535-54c1-4d42-bcb6-8f90745dff65 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.404720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70e535-54c1-4d42-bcb6-8f90745dff65 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.404987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70e535-54c1-4d42-bcb6-8f90745dff65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.413732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70e535-54c1-4d42-bcb6-8f90745dff65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:49.415254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70e535-54c1-4d42-bcb6-8f90745dff65 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:49.418422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-af70e535-54c1-4d42-bcb6-8f90745dff65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:49.430144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:49.432565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:49.434145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 436/885] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:19:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:49.437814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452affe-5dda-41c0-b9fd-fb09bae35ddd None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:49.509927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70e535-54c1-4d42-bcb6-8f90745dff65 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:49.562569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452affe-5dda-41c0-b9fd-fb09bae35ddd None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:49.596546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:49.609812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689510f-ae55-4cfc-b4a6-73b2d32edb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:49.610872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689510f-ae55-4cfc-b4a6-73b2d32edb93 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.611443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689510f-ae55-4cfc-b4a6-73b2d32edb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.612343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689510f-ae55-4cfc-b4a6-73b2d32edb93 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.612921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689510f-ae55-4cfc-b4a6-73b2d32edb93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:49.613807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689510f-ae55-4cfc-b4a6-73b2d32edb93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:49.615275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689510f-ae55-4cfc-b4a6-73b2d32edb93 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:49.642457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 450/886] 10.222.0.78 () {56 vars in 1149 bytes} [Wed Aug 24 03:19:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:49.649197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689510f-ae55-4cfc-b4a6-73b2d32edb93 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:49.667271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70e535-54c1-4d42-bcb6-8f90745dff65 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:49.706835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec403c-1e7b-49f2-9051-30811b877fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:49.707473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec403c-1e7b-49f2-9051-30811b877fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.707818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec403c-1e7b-49f2-9051-30811b877fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.708157 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec403c-1e7b-49f2-9051-30811b877fd7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.708827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec403c-1e7b-49f2-9051-30811b877fd7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:49.710286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec403c-1e7b-49f2-9051-30811b877fd7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-49ec403c-1e7b-49f2-9051-30811b877fd7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:49.722344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:49.723541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:49.724643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 437/887] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:19:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:49.730128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec403c-1e7b-49f2-9051-30811b877fd7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:49.775336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689510f-ae55-4cfc-b4a6-73b2d32edb93 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:49.809031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:49.813198 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b1ed0-3a06-481e-ab3e-05ddb7f5bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:49.813873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b1ed0-3a06-481e-ab3e-05ddb7f5bf61 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.814250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b1ed0-3a06-481e-ab3e-05ddb7f5bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.814616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b1ed0-3a06-481e-ab3e-05ddb7f5bf61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.850228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec403c-1e7b-49f2-9051-30811b877fd7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:49.877769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:49.899426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9088930-2e10-4e7b-974c-f29a0c2d6a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:49.900492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9088930-2e10-4e7b-974c-f29a0c2d6a29 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.900953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9088930-2e10-4e7b-974c-f29a0c2d6a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.901449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9088930-2e10-4e7b-974c-f29a0c2d6a29 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.902268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9088930-2e10-4e7b-974c-f29a0c2d6a29 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:49.902798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9088930-2e10-4e7b-974c-f29a0c2d6a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:49.902909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b1ed0-3a06-481e-ab3e-05ddb7f5bf61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:49.904450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9088930-2e10-4e7b-974c-f29a0c2d6a29 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:49.904560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b1ed0-3a06-481e-ab3e-05ddb7f5bf61 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:49.911419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 438/888] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:19:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:49.913101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1092ab-8226-4a3f-808f-4566b01cb947 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:49.913559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1092ab-8226-4a3f-808f-4566b01cb947 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:49.914000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1092ab-8226-4a3f-808f-4566b01cb947 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:49.915728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 439/889] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:49.917973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1092ab-8226-4a3f-808f-4566b01cb947 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:50.029360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 451/890] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:19:49 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:19:50.029360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf48128-d565-42e4-9477-611ac31cc9df None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:50.029360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf48128-d565-42e4-9477-611ac31cc9df None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:50.029360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf48128-d565-42e4-9477-611ac31cc9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:50.045209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1092ab-8226-4a3f-808f-4566b01cb947 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:50.046832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-faf48128-d565-42e4-9477-611ac31cc9df None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:50.048055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-faf48128-d565-42e4-9477-611ac31cc9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:50.079018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:50.090668 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401160a-ae60-48e2-85f9-02c9948f7242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:50.091302 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401160a-ae60-48e2-85f9-02c9948f7242 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:50.091581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401160a-ae60-48e2-85f9-02c9948f7242 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:50.091839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401160a-ae60-48e2-85f9-02c9948f7242 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:50.092482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401160a-ae60-48e2-85f9-02c9948f7242 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:50.092781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401160a-ae60-48e2-85f9-02c9948f7242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:50.094162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401160a-ae60-48e2-85f9-02c9948f7242 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:50.110680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 440/891] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:19:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:50.110680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401160a-ae60-48e2-85f9-02c9948f7242 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:50.144288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 452/892] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:50.237803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401160a-ae60-48e2-85f9-02c9948f7242 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:50.280191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6188b-6f98-4a07-8042-874b6a8f7a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:50.280897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6188b-6f98-4a07-8042-874b6a8f7a58 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:50.281168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6188b-6f98-4a07-8042-874b6a8f7a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:50.281454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6188b-6f98-4a07-8042-874b6a8f7a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:50.293808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6188b-6f98-4a07-8042-874b6a8f7a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:50.295308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6188b-6f98-4a07-8042-874b6a8f7a58 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-68d6188b-6f98-4a07-8042-874b6a8f7a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:50.312318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:50.313320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:50.314406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:50.314406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:50.314406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:50.314406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 441/893] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:50.321149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf48128-d565-42e4-9477-611ac31cc9df None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:50.338364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:50.431418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf48128-d565-42e4-9477-611ac31cc9df None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:50.452840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6188b-6f98-4a07-8042-874b6a8f7a58 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:50.473568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ae6b5-80fb-4f73-abd5-6424277a8e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:50.474463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae6b5-80fb-4f73-abd5-6424277a8e04 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:50.474822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae6b5-80fb-4f73-abd5-6424277a8e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:50.475546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae6b5-80fb-4f73-abd5-6424277a8e04 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:50.476207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ae6b5-80fb-4f73-abd5-6424277a8e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:50.476507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ae6b5-80fb-4f73-abd5-6424277a8e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:50.477902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ae6b5-80fb-4f73-abd5-6424277a8e04 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:50.498755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 453/894] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:50.502565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ae6b5-80fb-4f73-abd5-6424277a8e04 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:50.508873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:50.583031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6188b-6f98-4a07-8042-874b6a8f7a58 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:50.603206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:50.626534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ae6b5-80fb-4f73-abd5-6424277a8e04 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:50.631946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af56029-2c47-4080-bcf1-38354f2b8383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:50.632922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af56029-2c47-4080-bcf1-38354f2b8383 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:50.633703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af56029-2c47-4080-bcf1-38354f2b8383 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:50.634114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af56029-2c47-4080-bcf1-38354f2b8383 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:50.634877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af56029-2c47-4080-bcf1-38354f2b8383 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:50.636416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af56029-2c47-4080-bcf1-38354f2b8383 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-3af56029-2c47-4080-bcf1-38354f2b8383 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:50.649563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:50.650786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:19:50.651809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:50.654645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 442/895] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:19:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:50.662182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af56029-2c47-4080-bcf1-38354f2b8383 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:50.679790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a432-e0ab-443f-b351-2623f93bc28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:50.680824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a432-e0ab-443f-b351-2623f93bc28d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:50.681352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a432-e0ab-443f-b351-2623f93bc28d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:50.681820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a432-e0ab-443f-b351-2623f93bc28d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:50.689823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0a432-e0ab-443f-b351-2623f93bc28d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:50.691933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0a432-e0ab-443f-b351-2623f93bc28d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-9ca0a432-e0ab-443f-b351-2623f93bc28d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:50.704983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:50.706077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:50.706986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:50.706986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:50.706986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:50.706986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:50.706986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:50.706986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:50.706986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:50.706986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:50.709452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 454/896] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:50.716341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a432-e0ab-443f-b351-2623f93bc28d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:50.805361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af56029-2c47-4080-bcf1-38354f2b8383 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:50.819013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:50.858087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6aca0-0461-4bd8-957b-7cd2b6940b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:50.859227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6aca0-0461-4bd8-957b-7cd2b6940b64 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:50.860005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6aca0-0461-4bd8-957b-7cd2b6940b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:50.860731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6aca0-0461-4bd8-957b-7cd2b6940b64 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:50.861740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6aca0-0461-4bd8-957b-7cd2b6940b64 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:50.862340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6aca0-0461-4bd8-957b-7cd2b6940b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:50.864530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6aca0-0461-4bd8-957b-7cd2b6940b64 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:50.865855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a432-e0ab-443f-b351-2623f93bc28d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:50.876524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 443/897] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:19:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:50.878885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6aca0-0461-4bd8-957b-7cd2b6940b64 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:50.908249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:50.917055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b4b02-8c58-4430-8caf-597c23a8f5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:50.918132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b4b02-8c58-4430-8caf-597c23a8f5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:50.918483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b4b02-8c58-4430-8caf-597c23a8f5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:50.918849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b4b02-8c58-4430-8caf-597c23a8f5f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:50.919894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b4b02-8c58-4430-8caf-597c23a8f5f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:50.920263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b4b02-8c58-4430-8caf-597c23a8f5f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:50.922302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b4b02-8c58-4430-8caf-597c23a8f5f7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:50.943767 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 455/898] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:50.945019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b4b02-8c58-4430-8caf-597c23a8f5f7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:51.013521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6aca0-0461-4bd8-957b-7cd2b6940b64 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:51.057515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f13ee-2cdb-4002-8741-80c3ad8231e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:51.065879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f13ee-2cdb-4002-8741-80c3ad8231e1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:51.065879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f13ee-2cdb-4002-8741-80c3ad8231e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:51.065879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f13ee-2cdb-4002-8741-80c3ad8231e1 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:51.065879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f13ee-2cdb-4002-8741-80c3ad8231e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:51.065879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f13ee-2cdb-4002-8741-80c3ad8231e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:51.065879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f13ee-2cdb-4002-8741-80c3ad8231e1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:51.068516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b4b02-8c58-4430-8caf-597c23a8f5f7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:51.077562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 444/899] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:19:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:51.078940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f13ee-2cdb-4002-8741-80c3ad8231e1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:51.121113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31aa03-ef5b-442e-8a59-22e16d13be5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:51.121660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31aa03-ef5b-442e-8a59-22e16d13be5d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:51.121940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31aa03-ef5b-442e-8a59-22e16d13be5d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:51.122208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31aa03-ef5b-442e-8a59-22e16d13be5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:51.123285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31aa03-ef5b-442e-8a59-22e16d13be5d None admin] RBAC: Adding query filter params (role.id=8d116fbf411c4e1f88d93f56486ef2fb, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=f988895119ea43448a4a0f4e4a0274bd) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:51.123606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31aa03-ef5b-442e-8a59-22e16d13be5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:51.125134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31aa03-ef5b-442e-8a59-22e16d13be5d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:51.138684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 456/900] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:19:50 2022] GET /identity/v3/role_assignments?user.id=f988895119ea43448a4a0f4e4a0274bd&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=8d116fbf411c4e1f88d93f56486ef2fb => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:51.142778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:51.216591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f13ee-2cdb-4002-8741-80c3ad8231e1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:51.257231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2e63f-f862-460e-84ce-06fcedee601e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:51.257862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2e63f-f862-460e-84ce-06fcedee601e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:51.258139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2e63f-f862-460e-84ce-06fcedee601e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:51.258409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2e63f-f862-460e-84ce-06fcedee601e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:51.259185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2e63f-f862-460e-84ce-06fcedee601e None admin] RBAC: Adding query filter params (interface=public, service_id=6677f76e8dff402a8875005433d22e9a, region_id=RegionOne) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:51.259563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2e63f-f862-460e-84ce-06fcedee601e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:51.261063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2e63f-f862-460e-84ce-06fcedee601e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:51.268122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 445/901] 10.222.0.78 () {56 vars in 1251 bytes} [Wed Aug 24 03:19:51 2022] GET /identity/v3/endpoints?service_id=6677f76e8dff402a8875005433d22e9a&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:51.274449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31aa03-ef5b-442e-8a59-22e16d13be5d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:51.344666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:51.388746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9773c02-112b-46b5-9592-aa900d044611 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:51.388988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9773c02-112b-46b5-9592-aa900d044611 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:51.389352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9773c02-112b-46b5-9592-aa900d044611 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:51.390524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 446/902] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:51.395990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38468-d014-4f37-b67e-82ff8014de27 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:51.396359 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38468-d014-4f37-b67e-82ff8014de27 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:51.396521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d38468-d014-4f37-b67e-82ff8014de27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:51.412791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31aa03-ef5b-442e-8a59-22e16d13be5d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:51.420156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d4d38468-d014-4f37-b67e-82ff8014de27 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:51.421380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d4d38468-d014-4f37-b67e-82ff8014de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:51.462724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76a167-a71f-44ea-8fa6-e708ead04e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:51.464015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76a167-a71f-44ea-8fa6-e708ead04e23 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:51.464666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76a167-a71f-44ea-8fa6-e708ead04e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:51.465316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76a167-a71f-44ea-8fa6-e708ead04e23 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:51.466262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76a167-a71f-44ea-8fa6-e708ead04e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:51.468196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76a167-a71f-44ea-8fa6-e708ead04e23 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:51.476155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 457/903] 10.222.0.78 () {56 vars in 1087 bytes} [Wed Aug 24 03:19:51 2022] GET /identity/v3/services => generated 1268 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:19:51.508883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 447/904] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:51.797426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76a167-a71f-44ea-8fa6-e708ead04e23 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:51.958728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76a167-a71f-44ea-8fa6-e708ead04e23 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:51.981642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:51.997029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78e662-56b9-45d0-bd17-b1f2579873cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:51.997663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e662-56b9-45d0-bd17-b1f2579873cd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:51.997939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e662-56b9-45d0-bd17-b1f2579873cd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:51.998207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e662-56b9-45d0-bd17-b1f2579873cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:51.998852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78e662-56b9-45d0-bd17-b1f2579873cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:52.000233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78e662-56b9-45d0-bd17-b1f2579873cd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6e78e662-56b9-45d0-bd17-b1f2579873cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:52.010420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:52.011546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:52.012491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 458/905] 10.222.0.78 () {56 vars in 1132 bytes} [Wed Aug 24 03:19:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:52.017979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d38468-d014-4f37-b67e-82ff8014de27 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:52.051348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:52.127608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d38468-d014-4f37-b67e-82ff8014de27 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:52.138198 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5122-28cd-4cc4-95a0-94e828a0cc67 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:52.138523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5122-28cd-4cc4-95a0-94e828a0cc67 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:52.138782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5122-28cd-4cc4-95a0-94e828a0cc67 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:52.140404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 459/906] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:52.145947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24519478-e4d2-4cf1-9316-8a16b252f913 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:52.146251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24519478-e4d2-4cf1-9316-8a16b252f913 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:52.146495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24519478-e4d2-4cf1-9316-8a16b252f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:52.172096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec258f-e8fd-4043-bf9f-d3d30a626118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:52.172716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec258f-e8fd-4043-bf9f-d3d30a626118 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:52.172993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec258f-e8fd-4043-bf9f-d3d30a626118 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:52.173260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec258f-e8fd-4043-bf9f-d3d30a626118 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:52.173870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-24519478-e4d2-4cf1-9316-8a16b252f913 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:52.173986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec258f-e8fd-4043-bf9f-d3d30a626118 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:52.174189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec258f-e8fd-4043-bf9f-d3d30a626118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:52.175733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec258f-e8fd-4043-bf9f-d3d30a626118 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:52.176345 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-24519478-e4d2-4cf1-9316-8a16b252f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:52.181334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 448/907] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:19:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:52.188149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec258f-e8fd-4043-bf9f-d3d30a626118 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:52.292843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 460/908] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:19:52.309242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:52.317530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec258f-e8fd-4043-bf9f-d3d30a626118 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:52.354968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0f42-c815-4c0d-8460-082dc84407aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:52.355651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0f42-c815-4c0d-8460-082dc84407aa None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:52.355920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0f42-c815-4c0d-8460-082dc84407aa None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:52.356183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0f42-c815-4c0d-8460-082dc84407aa None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:52.356816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0f42-c815-4c0d-8460-082dc84407aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:52.357112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0f42-c815-4c0d-8460-082dc84407aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:52.358478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0f42-c815-4c0d-8460-082dc84407aa None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:52.364384 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 449/909] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:19:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:52.370006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24519478-e4d2-4cf1-9316-8a16b252f913 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:52.479928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24519478-e4d2-4cf1-9316-8a16b252f913 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:52.495142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:52.516228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfc749-4578-460d-8123-21d9da46f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:52.516913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfc749-4578-460d-8123-21d9da46f20d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:52.517189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfc749-4578-460d-8123-21d9da46f20d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:52.517450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfc749-4578-460d-8123-21d9da46f20d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:52.518153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfc749-4578-460d-8123-21d9da46f20d None admin] RBAC: Adding query filter params (interface=public, service_id=d30c445c80554e038804fbf76bffe0de, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:52.518579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfc749-4578-460d-8123-21d9da46f20d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:52.520002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfc749-4578-460d-8123-21d9da46f20d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:52.529415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 461/910] 10.222.0.78 () {56 vars in 1251 bytes} [Wed Aug 24 03:19:52 2022] GET /identity/v3/endpoints?service_id=d30c445c80554e038804fbf76bffe0de&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:52.535824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0f42-c815-4c0d-8460-082dc84407aa None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:52.601565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfc749-4578-460d-8123-21d9da46f20d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:52.651692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0f42-c815-4c0d-8460-082dc84407aa None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:52.694932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee7902-f718-464e-9dee-e558420f631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:52.695693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee7902-f718-464e-9dee-e558420f631c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:52.696045 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee7902-f718-464e-9dee-e558420f631c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:52.696314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee7902-f718-464e-9dee-e558420f631c None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:52.696929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee7902-f718-464e-9dee-e558420f631c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:52.699218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee7902-f718-464e-9dee-e558420f631c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:52.710846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 450/911] 10.222.0.78 () {56 vars in 1087 bytes} [Wed Aug 24 03:19:52 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:19:52.728473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfc749-4578-460d-8123-21d9da46f20d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:52.766903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67efb7-7bae-469a-9c2e-9f1d0c295d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:52.767941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67efb7-7bae-469a-9c2e-9f1d0c295d2f None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:52.768475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67efb7-7bae-469a-9c2e-9f1d0c295d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:52.768976 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67efb7-7bae-469a-9c2e-9f1d0c295d2f None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:52.769871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67efb7-7bae-469a-9c2e-9f1d0c295d2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:52.771555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67efb7-7bae-469a-9c2e-9f1d0c295d2f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:52.791163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 462/912] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:19:52 2022] POST /identity/v3/services => generated 241 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:19:53.277150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b8d84-0202-4fbc-81bf-2372c842595f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:53.277708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b8d84-0202-4fbc-81bf-2372c842595f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:53.277708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b8d84-0202-4fbc-81bf-2372c842595f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:53.279455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 451/913] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:53.285447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b38f4b-ecaa-43c5-9442-ca044ecdc876 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:53.285910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b38f4b-ecaa-43c5-9442-ca044ecdc876 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:53.286017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b38f4b-ecaa-43c5-9442-ca044ecdc876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:53.305632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-83b38f4b-ecaa-43c5-9442-ca044ecdc876 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:53.306877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-83b38f4b-ecaa-43c5-9442-ca044ecdc876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:53.342911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:53.394437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 463/914] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:53.489322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8d91d-51be-40da-b41e-411f3c214399 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:53.489981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8d91d-51be-40da-b41e-411f3c214399 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:53.490495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8d91d-51be-40da-b41e-411f3c214399 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:53.492353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 452/915] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:53.498016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886db2f-2630-4149-9de9-bf9853bfc047 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:53.498302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886db2f-2630-4149-9de9-bf9853bfc047 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:53.498580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886db2f-2630-4149-9de9-bf9853bfc047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:53.521577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a886db2f-2630-4149-9de9-bf9853bfc047 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:53.523208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a886db2f-2630-4149-9de9-bf9853bfc047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:53.598472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 464/916] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:53.670533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8d91d-51be-40da-b41e-411f3c214399 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:53.696640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:53.786158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8d91d-51be-40da-b41e-411f3c214399 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:53.824997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039da83-0110-4747-9d8e-ce6614f841e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:53.826039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039da83-0110-4747-9d8e-ce6614f841e4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:53.826520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039da83-0110-4747-9d8e-ce6614f841e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:53.827041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039da83-0110-4747-9d8e-ce6614f841e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:53.840321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039da83-0110-4747-9d8e-ce6614f841e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e039da83-0110-4747-9d8e-ce6614f841e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:53.845578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:53.846761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:19:53.848083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:53.854864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 453/917] 10.222.0.78 () {56 vars in 1120 bytes} [Wed Aug 24 03:19:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:53.858624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886db2f-2630-4149-9de9-bf9853bfc047 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:53.868907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039da83-0110-4747-9d8e-ce6614f841e4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:53.963891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:53.971499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886db2f-2630-4149-9de9-bf9853bfc047 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:53.981014 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:53.995594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039da83-0110-4747-9d8e-ce6614f841e4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:54.011927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97742a7e-0444-4679-8af0-57c4c845c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:54.012663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742a7e-0444-4679-8af0-57c4c845c508 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.012948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742a7e-0444-4679-8af0-57c4c845c508 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.013215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742a7e-0444-4679-8af0-57c4c845c508 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.013899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97742a7e-0444-4679-8af0-57c4c845c508 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:54.014200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97742a7e-0444-4679-8af0-57c4c845c508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:54.015715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97742a7e-0444-4679-8af0-57c4c845c508 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:54.025174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 465/918] 10.222.0.78 () {56 vars in 1115 bytes} [Wed Aug 24 03:19:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:54.030854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97742a7e-0444-4679-8af0-57c4c845c508 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:54.036976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15a42-910b-4dac-963c-b34afbc9ebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:54.037781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15a42-910b-4dac-963c-b34afbc9ebbf None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.038164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15a42-910b-4dac-963c-b34afbc9ebbf None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.038539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15a42-910b-4dac-963c-b34afbc9ebbf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.039300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15a42-910b-4dac-963c-b34afbc9ebbf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:54.040870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15a42-910b-4dac-963c-b34afbc9ebbf None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6ca15a42-910b-4dac-963c-b34afbc9ebbf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:54.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:54.054598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:54.056046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 454/919] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:19:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:54.060880 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15a42-910b-4dac-963c-b34afbc9ebbf None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:54.164873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97742a7e-0444-4679-8af0-57c4c845c508 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:54.181010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15a42-910b-4dac-963c-b34afbc9ebbf None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:54.202853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fce08-49b3-4809-a7d8-18d6965a0024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:54.203496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fce08-49b3-4809-a7d8-18d6965a0024 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.204101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fce08-49b3-4809-a7d8-18d6965a0024 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.204101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fce08-49b3-4809-a7d8-18d6965a0024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.215947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fce08-49b3-4809-a7d8-18d6965a0024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:54.217505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fce08-49b3-4809-a7d8-18d6965a0024 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:54.229859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add4bab-5537-4dd6-80b8-96218761e565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:54.230811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add4bab-5537-4dd6-80b8-96218761e565 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.231300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add4bab-5537-4dd6-80b8-96218761e565 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.231753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add4bab-5537-4dd6-80b8-96218761e565 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.232590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add4bab-5537-4dd6-80b8-96218761e565 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-2e0fce08-49b3-4809-a7d8-18d6965a0024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:54.232694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:54.233571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:54.234452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:54.234452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:54.234452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:54.234452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 466/920] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:54.235106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add4bab-5537-4dd6-80b8-96218761e565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:54.242916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add4bab-5537-4dd6-80b8-96218761e565 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:54.243198 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fce08-49b3-4809-a7d8-18d6965a0024 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:54.247358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 455/921] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:19:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:54.256033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add4bab-5537-4dd6-80b8-96218761e565 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:54.257510 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:54.280054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:54.361444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fce08-49b3-4809-a7d8-18d6965a0024 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:54.400762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb405bd-dda4-4c14-82f6-089379cddfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:54.401404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb405bd-dda4-4c14-82f6-089379cddfba None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.401683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb405bd-dda4-4c14-82f6-089379cddfba None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.401958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb405bd-dda4-4c14-82f6-089379cddfba None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.402609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb405bd-dda4-4c14-82f6-089379cddfba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:54.402940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb405bd-dda4-4c14-82f6-089379cddfba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:54.404424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb405bd-dda4-4c14-82f6-089379cddfba None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:54.417449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add4bab-5537-4dd6-80b8-96218761e565 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:54.422529 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 467/922] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:54.423657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb405bd-dda4-4c14-82f6-089379cddfba None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:54.461339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f48b5e-7a09-4b14-8304-04aa48539ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:54.462453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f48b5e-7a09-4b14-8304-04aa48539ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.463058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f48b5e-7a09-4b14-8304-04aa48539ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.463722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f48b5e-7a09-4b14-8304-04aa48539ed7 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.464685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f48b5e-7a09-4b14-8304-04aa48539ed7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:54.465339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f48b5e-7a09-4b14-8304-04aa48539ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:54.467062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f48b5e-7a09-4b14-8304-04aa48539ed7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:54.479340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 456/923] 10.222.0.78 () {56 vars in 1114 bytes} [Wed Aug 24 03:19:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:54.481095 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f48b5e-7a09-4b14-8304-04aa48539ed7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:54.498936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:54.537784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb405bd-dda4-4c14-82f6-089379cddfba None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:54.576640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ddb24-bd62-4eae-ba62-af0adfe793c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:54.577310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ddb24-bd62-4eae-ba62-af0adfe793c9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.577566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ddb24-bd62-4eae-ba62-af0adfe793c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.577844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ddb24-bd62-4eae-ba62-af0adfe793c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.585787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:54.586085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ddb24-bd62-4eae-ba62-af0adfe793c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:54.590710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ddb24-bd62-4eae-ba62-af0adfe793c9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7a3ddb24-bd62-4eae-ba62-af0adfe793c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:19:54.600636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:54.601747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:54.603490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 468/924] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:19:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:54.616912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ddb24-bd62-4eae-ba62-af0adfe793c9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:54.639947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f48b5e-7a09-4b14-8304-04aa48539ed7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:54.681109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf424-a592-4369-a5a6-36e84e5e20fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:54.682129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf424-a592-4369-a5a6-36e84e5e20fb None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.682623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf424-a592-4369-a5a6-36e84e5e20fb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.683190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf424-a592-4369-a5a6-36e84e5e20fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.684233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cf424-a592-4369-a5a6-36e84e5e20fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:54.685892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cf424-a592-4369-a5a6-36e84e5e20fb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:54.722938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 457/925] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:19:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:19:54.736222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ddb24-bd62-4eae-ba62-af0adfe793c9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:54.769956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:54.787619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55af1dc-6dc5-4c2f-95bd-89de2715b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:54.788248 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55af1dc-6dc5-4c2f-95bd-89de2715b344 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.788521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55af1dc-6dc5-4c2f-95bd-89de2715b344 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.788790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55af1dc-6dc5-4c2f-95bd-89de2715b344 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.789679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55af1dc-6dc5-4c2f-95bd-89de2715b344 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:54.790031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55af1dc-6dc5-4c2f-95bd-89de2715b344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:54.791691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55af1dc-6dc5-4c2f-95bd-89de2715b344 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:54.797846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34134f6-6fd9-4714-a34c-1184139306a6 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.798168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34134f6-6fd9-4714-a34c-1184139306a6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.798412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34134f6-6fd9-4714-a34c-1184139306a6 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.800261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 458/926] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:54.805972 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493181-41cf-4a49-a80f-7df1638a62d9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.806282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493181-41cf-4a49-a80f-7df1638a62d9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.806515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493181-41cf-4a49-a80f-7df1638a62d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.814052 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 469/927] 10.222.0.78 () {56 vars in 1149 bytes} [Wed Aug 24 03:19:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:54.823467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55af1dc-6dc5-4c2f-95bd-89de2715b344 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:54.828562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fa493181-41cf-4a49-a80f-7df1638a62d9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:54.829768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fa493181-41cf-4a49-a80f-7df1638a62d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:54.912059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 459/928] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:19:54.914468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802fe0-a885-467c-93d5-c2249ecf765a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.914782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802fe0-a885-467c-93d5-c2249ecf765a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.915055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802fe0-a885-467c-93d5-c2249ecf765a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.916720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 460/929] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:54.923159 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae602755-86d8-496e-a684-ed32317e654b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:54.923931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae602755-86d8-496e-a684-ed32317e654b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:54.924181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae602755-86d8-496e-a684-ed32317e654b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:54.946460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ae602755-86d8-496e-a684-ed32317e654b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:54.948963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ae602755-86d8-496e-a684-ed32317e654b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:54.963481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55af1dc-6dc5-4c2f-95bd-89de2715b344 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:55.009185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c05f43-96eb-4442-91b7-ad2f1f23ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:55.009870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c05f43-96eb-4442-91b7-ad2f1f23ad8f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:55.010148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c05f43-96eb-4442-91b7-ad2f1f23ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:55.010419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c05f43-96eb-4442-91b7-ad2f1f23ad8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:55.028180 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c05f43-96eb-4442-91b7-ad2f1f23ad8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:55.029561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:55.030967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c05f43-96eb-4442-91b7-ad2f1f23ad8f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:55.044453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 461/930] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f7c05f43-96eb-4442-91b7-ad2f1f23ad8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:55.053532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:55.054571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:55.055494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:55.055494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:55.055494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:55.055494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 470/931] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:55.060564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae602755-86d8-496e-a684-ed32317e654b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:55.165502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae602755-86d8-496e-a684-ed32317e654b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:55.196638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c05f43-96eb-4442-91b7-ad2f1f23ad8f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:55.203430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f003aa8-c7a8-419c-9aa4-289a4e136ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:55.204061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f003aa8-c7a8-419c-9aa4-289a4e136ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:55.204337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f003aa8-c7a8-419c-9aa4-289a4e136ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:55.204605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f003aa8-c7a8-419c-9aa4-289a4e136ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:55.205270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f003aa8-c7a8-419c-9aa4-289a4e136ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:55.205571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f003aa8-c7a8-419c-9aa4-289a4e136ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:55.207050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f003aa8-c7a8-419c-9aa4-289a4e136ca0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:55.222552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 462/932] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:55.228822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f003aa8-c7a8-419c-9aa4-289a4e136ca0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:55.243005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:55.302908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:55.325790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c05f43-96eb-4442-91b7-ad2f1f23ad8f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:55.362033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac800c5d-5017-4a80-be08-422efef04caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:55.362995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac800c5d-5017-4a80-be08-422efef04caf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:55.362995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac800c5d-5017-4a80-be08-422efef04caf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:55.363281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac800c5d-5017-4a80-be08-422efef04caf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:55.363791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f003aa8-c7a8-419c-9aa4-289a4e136ca0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:55.363904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac800c5d-5017-4a80-be08-422efef04caf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:55.365205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac800c5d-5017-4a80-be08-422efef04caf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ac800c5d-5017-4a80-be08-422efef04caf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:55.374406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:55.375607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:55.376516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 471/933] 10.222.0.78 () {56 vars in 1132 bytes} [Wed Aug 24 03:19:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:55.377416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac800c5d-5017-4a80-be08-422efef04caf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:55.416052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2949-3021-4236-9bd4-664f1d76e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:55.417177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2949-3021-4236-9bd4-664f1d76e55b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:55.417700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2949-3021-4236-9bd4-664f1d76e55b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:55.418224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2949-3021-4236-9bd4-664f1d76e55b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:55.429470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f2949-3021-4236-9bd4-664f1d76e55b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:55.432080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f2949-3021-4236-9bd4-664f1d76e55b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-725f2949-3021-4236-9bd4-664f1d76e55b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:55.455054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:55.456026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:55.456937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:55.456937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:55.456937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:55.456937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:55.456937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:55.456937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:55.456937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:55.456937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:55.463199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 463/934] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:19:55.464418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2949-3021-4236-9bd4-664f1d76e55b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:55.525444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:55.529965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac800c5d-5017-4a80-be08-422efef04caf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:55.569847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f793b5-07c4-4e51-b14c-1c98b3d0c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:55.570608 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f793b5-07c4-4e51-b14c-1c98b3d0c38c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:55.570933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f793b5-07c4-4e51-b14c-1c98b3d0c38c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:55.571200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f793b5-07c4-4e51-b14c-1c98b3d0c38c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:55.571794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f793b5-07c4-4e51-b14c-1c98b3d0c38c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:55.573570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f793b5-07c4-4e51-b14c-1c98b3d0c38c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a8f793b5-07c4-4e51-b14c-1c98b3d0c38c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:55.584309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:55.585397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:55.586249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 472/935] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:19:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:55.593329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f793b5-07c4-4e51-b14c-1c98b3d0c38c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:55.593530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2949-3021-4236-9bd4-664f1d76e55b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:55.617519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:55.646940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86afaf1-40ef-4160-99aa-03899e45baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:55.647675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86afaf1-40ef-4160-99aa-03899e45baaf None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:55.648019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86afaf1-40ef-4160-99aa-03899e45baaf None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:55.648360 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86afaf1-40ef-4160-99aa-03899e45baaf None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:55.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86afaf1-40ef-4160-99aa-03899e45baaf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:55.649446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86afaf1-40ef-4160-99aa-03899e45baaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:55.650970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86afaf1-40ef-4160-99aa-03899e45baaf None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:55.656267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 464/936] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:19:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:55.661264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86afaf1-40ef-4160-99aa-03899e45baaf None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:55.735333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f793b5-07c4-4e51-b14c-1c98b3d0c38c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:55.777966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c5ad8-029f-4dad-a69e-e9239d0cba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:55.778602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c5ad8-029f-4dad-a69e-e9239d0cba3e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:55.778894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c5ad8-029f-4dad-a69e-e9239d0cba3e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:55.779156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c5ad8-029f-4dad-a69e-e9239d0cba3e None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:55.779862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c5ad8-029f-4dad-a69e-e9239d0cba3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:55.780135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c5ad8-029f-4dad-a69e-e9239d0cba3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:55.781553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c5ad8-029f-4dad-a69e-e9239d0cba3e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:55.789329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86afaf1-40ef-4160-99aa-03899e45baaf None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:55.795233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 473/937] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:55.796004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c5ad8-029f-4dad-a69e-e9239d0cba3e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:55.833380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:55.840442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b2a7e-313d-4039-866a-ac12b17f3fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:55.841470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b2a7e-313d-4039-866a-ac12b17f3fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:55.841953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b2a7e-313d-4039-866a-ac12b17f3fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:55.842432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b2a7e-313d-4039-866a-ac12b17f3fa5 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:55.843653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b2a7e-313d-4039-866a-ac12b17f3fa5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:55.844204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b2a7e-313d-4039-866a-ac12b17f3fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:55.847098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b2a7e-313d-4039-866a-ac12b17f3fa5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:55.861265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 465/938] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:19:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:55.861265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b2a7e-313d-4039-866a-ac12b17f3fa5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:55.922314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:55.926840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c5ad8-029f-4dad-a69e-e9239d0cba3e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:55.972764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b8be-76af-49ef-bf8f-9112619ff2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:55.973395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b8be-76af-49ef-bf8f-9112619ff2da None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:55.973673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b8be-76af-49ef-bf8f-9112619ff2da None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:55.973943 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b8be-76af-49ef-bf8f-9112619ff2da None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:55.974597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256b8be-76af-49ef-bf8f-9112619ff2da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:55.974937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256b8be-76af-49ef-bf8f-9112619ff2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:55.976348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256b8be-76af-49ef-bf8f-9112619ff2da None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:55.988184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 474/939] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:19:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:55.988184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b8be-76af-49ef-bf8f-9112619ff2da None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:56.009986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b2a7e-313d-4039-866a-ac12b17f3fa5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:56.055808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f0aef-f674-44e5-acf8-8751995fded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:56.056896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f0aef-f674-44e5-acf8-8751995fded0 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:56.057374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f0aef-f674-44e5-acf8-8751995fded0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:56.057847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f0aef-f674-44e5-acf8-8751995fded0 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/f988895119ea43448a4a0f4e4a0274bd/roles/8d116fbf411c4e1f88d93f56486ef2fb` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:56.061946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f0aef-f674-44e5-acf8-8751995fded0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=f988895119ea43448a4a0f4e4a0274bd, role_id=8d116fbf411c4e1f88d93f56486ef2fb)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:56.064489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f0aef-f674-44e5-acf8-8751995fded0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:56.098691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 466/940] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:19:55 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/f988895119ea43448a4a0f4e4a0274bd/roles/8d116fbf411c4e1f88d93f56486ef2fb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:19:56.098691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f0aef-f674-44e5-acf8-8751995fded0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:56.121023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:56.148338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b8be-76af-49ef-bf8f-9112619ff2da None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:56.199940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb65df-ffe3-4c68-81c2-c880080c2cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:56.200814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb65df-ffe3-4c68-81c2-c880080c2cbf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:56.201279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb65df-ffe3-4c68-81c2-c880080c2cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:56.201558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb65df-ffe3-4c68-81c2-c880080c2cbf None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:56.202242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb65df-ffe3-4c68-81c2-c880080c2cbf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:56.202593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb65df-ffe3-4c68-81c2-c880080c2cbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:56.204074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb65df-ffe3-4c68-81c2-c880080c2cbf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:56.212819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 475/941] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:19:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:56.219666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb65df-ffe3-4c68-81c2-c880080c2cbf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:56.272567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:56.276330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f0aef-f674-44e5-acf8-8751995fded0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:56.341756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfcf03-6b96-4a78-97e8-1186bf7c458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:56.343132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfcf03-6b96-4a78-97e8-1186bf7c458c None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:56.343729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfcf03-6b96-4a78-97e8-1186bf7c458c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:56.344330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfcf03-6b96-4a78-97e8-1186bf7c458c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:56.345655 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfcf03-6b96-4a78-97e8-1186bf7c458c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:56.348221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfcf03-6b96-4a78-97e8-1186bf7c458c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:56.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb65df-ffe3-4c68-81c2-c880080c2cbf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:56.385688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 467/942] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:19:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:19:56.398093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fa5e7-a622-4fe1-8dd2-4f62682f76b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:56.399513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fa5e7-a622-4fe1-8dd2-4f62682f76b3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:56.399939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fa5e7-a622-4fe1-8dd2-4f62682f76b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:56.400357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fa5e7-a622-4fe1-8dd2-4f62682f76b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:56.401310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fa5e7-a622-4fe1-8dd2-4f62682f76b3 None admin] RBAC: Adding query filter params (interface=public, service_id=f259c46401bd417e8015dc0d9a0f52e1, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:56.401783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fa5e7-a622-4fe1-8dd2-4f62682f76b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:56.403488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fa5e7-a622-4fe1-8dd2-4f62682f76b3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:56.410859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 476/943] 10.222.0.78 () {56 vars in 1251 bytes} [Wed Aug 24 03:19:56 2022] GET /identity/v3/endpoints?service_id=f259c46401bd417e8015dc0d9a0f52e1&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:19:56.417931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfcf03-6b96-4a78-97e8-1186bf7c458c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:56.619375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfcf03-6b96-4a78-97e8-1186bf7c458c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:56.663235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d112a7-efcb-4456-a483-0061cd3fce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:56.663870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d112a7-efcb-4456-a483-0061cd3fce5a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:56.664143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d112a7-efcb-4456-a483-0061cd3fce5a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:56.664500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d112a7-efcb-4456-a483-0061cd3fce5a None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:56.665246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d112a7-efcb-4456-a483-0061cd3fce5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:56.666756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d112a7-efcb-4456-a483-0061cd3fce5a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:56.674920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 468/944] 10.222.0.78 () {56 vars in 1087 bytes} [Wed Aug 24 03:19:56 2022] GET /identity/v3/services => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:19:56.818242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8d861-303b-49a7-924c-fd07b6e03778 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:56.818615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8d861-303b-49a7-924c-fd07b6e03778 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:56.818823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8d861-303b-49a7-924c-fd07b6e03778 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:56.820551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 477/945] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:56.827640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63624d9b-0661-43d1-8b45-be8c5da69a64 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:56.827640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63624d9b-0661-43d1-8b45-be8c5da69a64 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:56.827640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63624d9b-0661-43d1-8b45-be8c5da69a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:56.848380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-63624d9b-0661-43d1-8b45-be8c5da69a64 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:56.848585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-63624d9b-0661-43d1-8b45-be8c5da69a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:56.865440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:56.931101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 469/946] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:57.198025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8d861-303b-49a7-924c-fd07b6e03778 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:57.212402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:57.335416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8d861-303b-49a7-924c-fd07b6e03778 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:57.379052 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:57.379675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:57.379954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:57.380225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:57.380880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:57.382344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:57.385055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING keystone.server.flask.common [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 03:19:57.406288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.sql.core [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:19:57.406288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 03:19:57.406288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [parameters: {'id': '27f5128af0ed422d956f6bde10df7da2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 03:19:57.406288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81534) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27f5128af0ed422d956f6bde10df7da2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27f5128af0ed422d956f6bde10df7da2. Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:19:57.423947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application result.read() Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 03:19:57.424918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application yield resource Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise self.value Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application session.commit() Aug 24 03:19:57.426124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:19:57.428338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:19:57.430513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application result.read() Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:19:57.436718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [parameters: {'id': '27f5128af0ed422d956f6bde10df7da2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:57.439023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:57.441409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27f5128af0ed422d956f6bde10df7da2. Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:57.443672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 478/947] 10.222.0.78 () {60 vars in 1140 bytes} [Wed Aug 24 03:19:57 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:57.450096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63624d9b-0661-43d1-8b45-be8c5da69a64 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:57.561087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63624d9b-0661-43d1-8b45-be8c5da69a64 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:57.613939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc491e47-1e9c-43ce-a622-e38ed529dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:57.614682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491e47-1e9c-43ce-a622-e38ed529dff2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:57.614975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491e47-1e9c-43ce-a622-e38ed529dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:57.615276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491e47-1e9c-43ce-a622-e38ed529dff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:57.624300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491e47-1e9c-43ce-a622-e38ed529dff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:57.626308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491e47-1e9c-43ce-a622-e38ed529dff2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-cc491e47-1e9c-43ce-a622-e38ed529dff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:19:57.640093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:57.641046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:57.642077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:19:57.642077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:19:57.642077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:19:57.642077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:19:57.642077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:19:57.642077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:19:57.642077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:19:57.642077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:57.642520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 470/948] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:57.649547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:57.731849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:57.773392 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f315d-7f76-440e-9848-7a1b200af2f0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:57.823126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf8689-48d1-45bd-a6bd-084a5a05ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:57.824203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf8689-48d1-45bd-a6bd-084a5a05ed2d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:57.824695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf8689-48d1-45bd-a6bd-084a5a05ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:57.825176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf8689-48d1-45bd-a6bd-084a5a05ed2d None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:57.826428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf8689-48d1-45bd-a6bd-084a5a05ed2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:57.827025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf8689-48d1-45bd-a6bd-084a5a05ed2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:57.830436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf8689-48d1-45bd-a6bd-084a5a05ed2d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:57.870096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 479/949] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:19:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:58.217831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35733a91-4302-4141-a3a0-f30511f0faeb None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:58.218253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35733a91-4302-4141-a3a0-f30511f0faeb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:58.218379 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35733a91-4302-4141-a3a0-f30511f0faeb None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:58.220043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 471/950] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:58.227009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cc7cc-ddbf-435c-9101-76ab53ccdaca None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:58.227514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cc7cc-ddbf-435c-9101-76ab53ccdaca None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:58.228008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cc7cc-ddbf-435c-9101-76ab53ccdaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:58.251100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f47cc7cc-ddbf-435c-9101-76ab53ccdaca None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:58.252759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f47cc7cc-ddbf-435c-9101-76ab53ccdaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:58.328532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 480/951] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:58.541813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b9c38-71d9-4797-8dd8-35d311b3f776 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:58.542333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b9c38-71d9-4797-8dd8-35d311b3f776 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:58.542333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b9c38-71d9-4797-8dd8-35d311b3f776 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:58.544039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 472/952] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:58.549931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1e7f-3ae8-436a-98ae-1c9b56b95ec1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:58.550443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1e7f-3ae8-436a-98ae-1c9b56b95ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:58.550520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1e7f-3ae8-436a-98ae-1c9b56b95ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:58.571345 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d1dc1e7f-3ae8-436a-98ae-1c9b56b95ec1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:58.572990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d1dc1e7f-3ae8-436a-98ae-1c9b56b95ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:58.615195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b9c38-71d9-4797-8dd8-35d311b3f776 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:58.631059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:58.646550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:58.674381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 481/953] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:19:58.748786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b9c38-71d9-4797-8dd8-35d311b3f776 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:58.790278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8de7b6-c75d-4b83-97e5-5ced917d611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:58.791316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de7b6-c75d-4b83-97e5-5ced917d611d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:58.791797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de7b6-c75d-4b83-97e5-5ced917d611d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:58.792323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de7b6-c75d-4b83-97e5-5ced917d611d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:58.805272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8de7b6-c75d-4b83-97e5-5ced917d611d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ad8de7b6-c75d-4b83-97e5-5ced917d611d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:19:58.810611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:58.811587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:19:58.812421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:58.815294 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 473/954] 10.222.0.78 () {56 vars in 1120 bytes} [Wed Aug 24 03:19:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:58.823696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1e7f-3ae8-436a-98ae-1c9b56b95ec1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:58.948279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1e7f-3ae8-436a-98ae-1c9b56b95ec1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:58.960800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a8861-dfe0-4387-80bb-210494aa23c2 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:58.961504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a8861-dfe0-4387-80bb-210494aa23c2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:58.961997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a8861-dfe0-4387-80bb-210494aa23c2 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:58.964086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 474/955] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:19:58.974085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63835db-493c-41c2-847b-1f1403957150 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:58.974772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63835db-493c-41c2-847b-1f1403957150 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:58.975384 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63835db-493c-41c2-847b-1f1403957150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:58.992215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81177ac-e3b1-477e-baf6-8522782fa676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:58.993014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81177ac-e3b1-477e-baf6-8522782fa676 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:58.993353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81177ac-e3b1-477e-baf6-8522782fa676 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:58.993651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81177ac-e3b1-477e-baf6-8522782fa676 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:58.994343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81177ac-e3b1-477e-baf6-8522782fa676 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:58.994647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81177ac-e3b1-477e-baf6-8522782fa676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:58.996118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81177ac-e3b1-477e-baf6-8522782fa676 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:58.999898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f63835db-493c-41c2-847b-1f1403957150 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:19:59.001408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f63835db-493c-41c2-847b-1f1403957150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:19:59.009489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 482/956] 10.222.0.78 () {56 vars in 1115 bytes} [Wed Aug 24 03:19:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:59.010679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81177ac-e3b1-477e-baf6-8522782fa676 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:59.107561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:59.109520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:59.126737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 475/957] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:19:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:19:59.126737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63835db-493c-41c2-847b-1f1403957150 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:59.198948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81177ac-e3b1-477e-baf6-8522782fa676 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:59.263099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d295530-74b2-4f33-aa73-4604026ab099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:59.264079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d295530-74b2-4f33-aa73-4604026ab099 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:59.264656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d295530-74b2-4f33-aa73-4604026ab099 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:59.264965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d295530-74b2-4f33-aa73-4604026ab099 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:59.265947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d295530-74b2-4f33-aa73-4604026ab099 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:59.268580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d295530-74b2-4f33-aa73-4604026ab099 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:59.284771 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63835db-493c-41c2-847b-1f1403957150 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5d295530-74b2-4f33-aa73-4604026ab099 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:59.285231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:59.287460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:19:59.289627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:19:59.295304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 483/958] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:19:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:59.297864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d295530-74b2-4f33-aa73-4604026ab099 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:59.368160 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e17ce-a945-4aea-8428-e92b85847bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:59.369541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e17ce-a945-4aea-8428-e92b85847bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:59.370216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e17ce-a945-4aea-8428-e92b85847bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:59.370917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e17ce-a945-4aea-8428-e92b85847bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:59.392395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e17ce-a945-4aea-8428-e92b85847bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:59.396393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e17ce-a945-4aea-8428-e92b85847bd5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-a95e17ce-a945-4aea-8428-e92b85847bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:19:59.425910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:59.427924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:19:59.429307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:19:59.429307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:19:59.429307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:59.429307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 476/959] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:59.429307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e17ce-a945-4aea-8428-e92b85847bd5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:59.479581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d295530-74b2-4f33-aa73-4604026ab099 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:59.499395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:59.512113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:59.528158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c8eec-fc8d-4a05-8dbf-0b590e3b83db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:59.529141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c8eec-fc8d-4a05-8dbf-0b590e3b83db None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:59.529578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c8eec-fc8d-4a05-8dbf-0b590e3b83db None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:59.530050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c8eec-fc8d-4a05-8dbf-0b590e3b83db None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:59.531127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c8eec-fc8d-4a05-8dbf-0b590e3b83db None admin] RBAC: Adding query filter params (name=compute) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:59.531585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c8eec-fc8d-4a05-8dbf-0b590e3b83db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:59.534108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c8eec-fc8d-4a05-8dbf-0b590e3b83db None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:59.542098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 484/960] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:19:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:59.547712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c8eec-fc8d-4a05-8dbf-0b590e3b83db None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:59.578117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e17ce-a945-4aea-8428-e92b85847bd5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:59.630329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc892473-09a3-4e74-9cce-039e86ffe283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:59.631210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc892473-09a3-4e74-9cce-039e86ffe283 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:59.631597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc892473-09a3-4e74-9cce-039e86ffe283 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:59.632981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc892473-09a3-4e74-9cce-039e86ffe283 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:59.633147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc892473-09a3-4e74-9cce-039e86ffe283 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:59.634836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc892473-09a3-4e74-9cce-039e86ffe283 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-dc892473-09a3-4e74-9cce-039e86ffe283 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:19:59.647079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:19:59.648230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:19:59.649071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 477/961] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:19:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:19:59.649997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc892473-09a3-4e74-9cce-039e86ffe283 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:59.677419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c8eec-fc8d-4a05-8dbf-0b590e3b83db None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:59.728052 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50dbb-1b9e-4245-bc47-819827aa522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:59.728885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50dbb-1b9e-4245-bc47-819827aa522d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:59.729209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50dbb-1b9e-4245-bc47-819827aa522d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:59.729479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50dbb-1b9e-4245-bc47-819827aa522d None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:59.730131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50dbb-1b9e-4245-bc47-819827aa522d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:59.730454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50dbb-1b9e-4245-bc47-819827aa522d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:59.732162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50dbb-1b9e-4245-bc47-819827aa522d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:59.751561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 485/962] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:59.751561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50dbb-1b9e-4245-bc47-819827aa522d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:59.778107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc892473-09a3-4e74-9cce-039e86ffe283 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:59.793084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:59.795961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:59.830137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d0b4-666d-42f7-888c-766bc5e3e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:59.831019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d0b4-666d-42f7-888c-766bc5e3e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:59.831472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d0b4-666d-42f7-888c-766bc5e3e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:59.831934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d0b4-666d-42f7-888c-766bc5e3e7e2 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:59.832585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633d0b4-666d-42f7-888c-766bc5e3e7e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:59.832885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633d0b4-666d-42f7-888c-766bc5e3e7e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:59.834252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633d0b4-666d-42f7-888c-766bc5e3e7e2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:59.840444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 478/963] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:19:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:59.841926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d0b4-666d-42f7-888c-766bc5e3e7e2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:19:59.899172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50dbb-1b9e-4245-bc47-819827aa522d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:19:59.941882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0179715-4472-4282-bc8f-d1e8c386f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:19:59.942514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0179715-4472-4282-bc8f-d1e8c386f975 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:59.942836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0179715-4472-4282-bc8f-d1e8c386f975 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:59.943108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0179715-4472-4282-bc8f-d1e8c386f975 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:59.943763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0179715-4472-4282-bc8f-d1e8c386f975 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:19:59.944071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0179715-4472-4282-bc8f-d1e8c386f975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:19:59.945488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0179715-4472-4282-bc8f-d1e8c386f975 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:19:59.952220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 486/964] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:19:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:19:59.953845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba0a7c-c61b-41fa-ab65-1c0ba65565f1 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:19:59.954126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba0a7c-c61b-41fa-ab65-1c0ba65565f1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:19:59.954539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba0a7c-c61b-41fa-ab65-1c0ba65565f1 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:19:59.956336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 487/965] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:19:59.958438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba0a7c-c61b-41fa-ab65-1c0ba65565f1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:00.025928 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d0b4-666d-42f7-888c-766bc5e3e7e2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:00.066786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a525dde-2fee-4dcd-980a-c2ca34f54a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:00.068334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525dde-2fee-4dcd-980a-c2ca34f54a26 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:00.068609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525dde-2fee-4dcd-980a-c2ca34f54a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:00.068879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a525dde-2fee-4dcd-980a-c2ca34f54a26 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:00.079515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a525dde-2fee-4dcd-980a-c2ca34f54a26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:00.082202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a525dde-2fee-4dcd-980a-c2ca34f54a26 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6a525dde-2fee-4dcd-980a-c2ca34f54a26 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:20:00.098261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:00.100335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 479/966] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:19:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926724-4fcc-456a-9c82-2f380baad694 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:00.102165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926724-4fcc-456a-9c82-2f380baad694 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:00.103637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926724-4fcc-456a-9c82-2f380baad694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:00.105434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:00.111929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba0a7c-c61b-41fa-ab65-1c0ba65565f1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:00.125101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-52926724-4fcc-456a-9c82-2f380baad694 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:00.126638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-52926724-4fcc-456a-9c82-2f380baad694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:00.152032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bffdef-bd92-4d62-96fe-be655bfbb16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:00.152954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bffdef-bd92-4d62-96fe-be655bfbb16a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:00.153454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bffdef-bd92-4d62-96fe-be655bfbb16a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:00.153717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bffdef-bd92-4d62-96fe-be655bfbb16a None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:00.154361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bffdef-bd92-4d62-96fe-be655bfbb16a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:00.154682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bffdef-bd92-4d62-96fe-be655bfbb16a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:00.156136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bffdef-bd92-4d62-96fe-be655bfbb16a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:00.163085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 488/967] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:19:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:00.168655 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:00.168909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bffdef-bd92-4d62-96fe-be655bfbb16a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:00.222708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 480/968] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:00.222708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52926724-4fcc-456a-9c82-2f380baad694 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:00.306868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bffdef-bd92-4d62-96fe-be655bfbb16a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:00.355175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e52d2-ee60-4b96-bb78-450c63bc82cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:00.356027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e52d2-ee60-4b96-bb78-450c63bc82cb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:00.356396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e52d2-ee60-4b96-bb78-450c63bc82cb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:00.356761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e52d2-ee60-4b96-bb78-450c63bc82cb None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:00.357669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e52d2-ee60-4b96-bb78-450c63bc82cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:00.358072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e52d2-ee60-4b96-bb78-450c63bc82cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:00.359672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e52d2-ee60-4b96-bb78-450c63bc82cb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:00.376861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52926724-4fcc-456a-9c82-2f380baad694 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:00.383959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 489/969] 10.222.0.78 () {56 vars in 1149 bytes} [Wed Aug 24 03:20:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:00.389783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e52d2-ee60-4b96-bb78-450c63bc82cb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:00.420621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:00.451499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b842-9504-4036-9200-99766bbdac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:00.452128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b842-9504-4036-9200-99766bbdac67 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:00.452407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b842-9504-4036-9200-99766bbdac67 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:00.452685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b842-9504-4036-9200-99766bbdac67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:00.453365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6b842-9504-4036-9200-99766bbdac67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:00.455284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6b842-9504-4036-9200-99766bbdac67 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:00.483731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 481/970] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:20:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:20:00.524556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e52d2-ee60-4b96-bb78-450c63bc82cb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:00.561011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b842-9504-4036-9200-99766bbdac67 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:00.577667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ba996-bf3b-4e9c-aa8b-51eff801a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:00.578596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ba996-bf3b-4e9c-aa8b-51eff801a500 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:00.579060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ba996-bf3b-4e9c-aa8b-51eff801a500 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:00.579465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ba996-bf3b-4e9c-aa8b-51eff801a500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:00.597787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:00.667642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ba996-bf3b-4e9c-aa8b-51eff801a500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:00.668769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ba996-bf3b-4e9c-aa8b-51eff801a500 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:00.698263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:00.716965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b842-9504-4036-9200-99766bbdac67 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:00.777038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:00.777682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:00.778010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:00.778733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:00.780064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:00.781695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:00.786341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WARNING keystone.server.flask.common [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 03:20:00.804780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.sql.core [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:20:00.804780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 03:20:00.804780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [parameters: {'user_id': 'ebc842d305c94a3481607bf31c6a5422', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 03:20:00.804780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 03:20:00.815522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:20:00.816587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application yield resource Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise self.value Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application session.commit() Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:20:00.817753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:20:00.818850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:20:00.819980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:20:00.821013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ebc842d305c94a3481607bf31c6a5422', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:00.822054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 03:20:00.823439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 03:20:00.824500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 03:20:00.824500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 03:20:00.824500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:20:00.824500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:20:00.824500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 03:20:00.824500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:00.824500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 482/971] 10.222.0.78 () {60 vars in 1131 bytes} [Wed Aug 24 03:20:00 2022] POST /identity/v3/users => generated 160 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:00.833555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:00.863160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 490/972] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:00 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:00.871637 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ba996-bf3b-4e9c-aa8b-51eff801a500 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:00.997107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:01.020524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984f89d-11e2-4de6-b62a-5b6119ab93c4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:01.036521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ba996-bf3b-4e9c-aa8b-51eff801a500 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:01.058438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:01.063759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a8ba-0b2f-49c3-9579-9e45d2894011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:01.064820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a8ba-0b2f-49c3-9579-9e45d2894011 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:01.065475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a8ba-0b2f-49c3-9579-9e45d2894011 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:01.065889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a8ba-0b2f-49c3-9579-9e45d2894011 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:01.077367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299a8ba-0b2f-49c3-9579-9e45d2894011 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:01.079537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299a8ba-0b2f-49c3-9579-9e45d2894011 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:01.080251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae9c67-dc10-4c78-aece-e96e6732034f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:01.081055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae9c67-dc10-4c78-aece-e96e6732034f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:01.081394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae9c67-dc10-4c78-aece-e96e6732034f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:01.081771 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae9c67-dc10-4c78-aece-e96e6732034f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-a299a8ba-0b2f-49c3-9579-9e45d2894011 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:20:01.092918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:01.095469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:20:01.097722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:01.098846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae9c67-dc10-4c78-aece-e96e6732034f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:01.098990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 483/973] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:20:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:01.099123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae9c67-dc10-4c78-aece-e96e6732034f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:01.102781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a8ba-0b2f-49c3-9579-9e45d2894011 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c3ae9c67-dc10-4c78-aece-e96e6732034f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:20:01.115230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:01.117188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:20:01.118089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:20:01.118089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:01.118089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:01.120559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 491/974] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:01.121519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae9c67-dc10-4c78-aece-e96e6732034f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:01.235315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae9c67-dc10-4c78-aece-e96e6732034f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:01.235995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a8ba-0b2f-49c3-9579-9e45d2894011 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:01.275322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799f45-20fb-4a45-ae83-10d7bb441c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:01.275864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799f45-20fb-4a45-ae83-10d7bb441c8b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:01.276150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799f45-20fb-4a45-ae83-10d7bb441c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:01.276396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799f45-20fb-4a45-ae83-10d7bb441c8b None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:01.277064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799f45-20fb-4a45-ae83-10d7bb441c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:01.277338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799f45-20fb-4a45-ae83-10d7bb441c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:01.278133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fe0c5-f8c3-4e40-a46f-ecb4e8290821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:01.278785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799f45-20fb-4a45-ae83-10d7bb441c8b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:01.279230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fe0c5-f8c3-4e40-a46f-ecb4e8290821 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:01.279719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fe0c5-f8c3-4e40-a46f-ecb4e8290821 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:01.280180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fe0c5-f8c3-4e40-a46f-ecb4e8290821 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:01.281163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fe0c5-f8c3-4e40-a46f-ecb4e8290821 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:01.281711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fe0c5-f8c3-4e40-a46f-ecb4e8290821 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:01.283378 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fe0c5-f8c3-4e40-a46f-ecb4e8290821 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:01.297917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 492/975] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:01.299024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799f45-20fb-4a45-ae83-10d7bb441c8b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:01.334765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 484/976] 10.222.0.78 () {56 vars in 1101 bytes} [Wed Aug 24 03:20:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:01.336742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:01.415261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799f45-20fb-4a45-ae83-10d7bb441c8b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:01.457417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4d206-df51-408d-8296-dc636ac84035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:01.458079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4d206-df51-408d-8296-dc636ac84035 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:01.458397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4d206-df51-408d-8296-dc636ac84035 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:01.458682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4d206-df51-408d-8296-dc636ac84035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:01.467271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4d206-df51-408d-8296-dc636ac84035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:01.468868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4d206-df51-408d-8296-dc636ac84035 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-88d4d206-df51-408d-8296-dc636ac84035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:20:01.482298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:01.483335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:01.484235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:20:01.484235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:20:01.484235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:20:01.484235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:20:01.484235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:20:01.484235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:20:01.484235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:20:01.484235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:01.484235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 493/977] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:01.490413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fe0c5-f8c3-4e40-a46f-ecb4e8290821 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:01.496855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:01.611676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fe0c5-f8c3-4e40-a46f-ecb4e8290821 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:01.650813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ea1a-1977-4ea6-b6c9-aa92fd20106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:01.651438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ea1a-1977-4ea6-b6c9-aa92fd20106e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:01.651715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ea1a-1977-4ea6-b6c9-aa92fd20106e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:01.651983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ea1a-1977-4ea6-b6c9-aa92fd20106e None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:01.652691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ea1a-1977-4ea6-b6c9-aa92fd20106e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:01.652995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ea1a-1977-4ea6-b6c9-aa92fd20106e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:01.654428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ea1a-1977-4ea6-b6c9-aa92fd20106e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:01.667517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 485/978] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:01.674126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4d206-df51-408d-8296-dc636ac84035 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:01.795195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:01.811671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4d206-df51-408d-8296-dc636ac84035 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:01.862480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadc1db-c685-4756-8451-9bc364964940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:01.863949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc1db-c685-4756-8451-9bc364964940 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:01.864455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc1db-c685-4756-8451-9bc364964940 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:01.864931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc1db-c685-4756-8451-9bc364964940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:01.865881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadc1db-c685-4756-8451-9bc364964940 None admin] RBAC: Adding query filter params (role.id=8d116fbf411c4e1f88d93f56486ef2fb, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=f988895119ea43448a4a0f4e4a0274bd) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:01.866492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadc1db-c685-4756-8451-9bc364964940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:01.868279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadc1db-c685-4756-8451-9bc364964940 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:01.884081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 494/979] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:20:01 2022] GET /identity/v3/role_assignments?user.id=f988895119ea43448a4a0f4e4a0274bd&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=8d116fbf411c4e1f88d93f56486ef2fb => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:01.943653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c8a56-50ae-4a8b-b80c-3c5b6b0b243d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:01.943979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c8a56-50ae-4a8b-b80c-3c5b6b0b243d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:01.944192 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c8a56-50ae-4a8b-b80c-3c5b6b0b243d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:01.945863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 486/980] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:01.952186 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261516c9-5a49-4242-a041-f597adf5f3a3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:01.952497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261516c9-5a49-4242-a041-f597adf5f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:01.952733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261516c9-5a49-4242-a041-f597adf5f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:01.973515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-261516c9-5a49-4242-a041-f597adf5f3a3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:01.974848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-261516c9-5a49-4242-a041-f597adf5f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:02.075222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 495/981] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:02.340883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c8a56-50ae-4a8b-b80c-3c5b6b0b243d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:02.409999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:02.455801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c8a56-50ae-4a8b-b80c-3c5b6b0b243d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:02.492982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cff714-aa9f-4301-abf4-5ee707be28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:02.493994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cff714-aa9f-4301-abf4-5ee707be28a1 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:02.494487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cff714-aa9f-4301-abf4-5ee707be28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:02.494953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cff714-aa9f-4301-abf4-5ee707be28a1 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:02.495877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cff714-aa9f-4301-abf4-5ee707be28a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:02.497438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cff714-aa9f-4301-abf4-5ee707be28a1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:02.518724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 487/982] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:20:02 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:20:02.593810 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237b84e-f8e3-4a99-b4bd-fb2de9973b83 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:02.594109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237b84e-f8e3-4a99-b4bd-fb2de9973b83 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:02.594292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237b84e-f8e3-4a99-b4bd-fb2de9973b83 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:02.595921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 496/983] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:02.601815 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86228c9-66a7-4daf-b3b9-5ccf6697cb47 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:02.602162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86228c9-66a7-4daf-b3b9-5ccf6697cb47 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:02.602384 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86228c9-66a7-4daf-b3b9-5ccf6697cb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:02.626601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d86228c9-66a7-4daf-b3b9-5ccf6697cb47 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:02.628405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d86228c9-66a7-4daf-b3b9-5ccf6697cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:02.715522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 488/984] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:02.988946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237b84e-f8e3-4a99-b4bd-fb2de9973b83 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:03.091778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:03.111080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237b84e-f8e3-4a99-b4bd-fb2de9973b83 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:03.149453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f141f11-0ec7-4164-8794-ed21ddc55a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:03.150096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f141f11-0ec7-4164-8794-ed21ddc55a02 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:03.150376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f141f11-0ec7-4164-8794-ed21ddc55a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:03.150646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f141f11-0ec7-4164-8794-ed21ddc55a02 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:03.151266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f141f11-0ec7-4164-8794-ed21ddc55a02 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:03.152648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f141f11-0ec7-4164-8794-ed21ddc55a02 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0f141f11-0ec7-4164-8794-ed21ddc55a02 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:03.162201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:03.163243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:20:03.164072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:03.167027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 497/985] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:20:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:03.169636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86228c9-66a7-4daf-b3b9-5ccf6697cb47 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:03.233370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:03.297052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86228c9-66a7-4daf-b3b9-5ccf6697cb47 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:03.342897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48f0a3-69a3-485e-b8bd-a44a6b48918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:03.343538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48f0a3-69a3-485e-b8bd-a44a6b48918e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:03.343819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48f0a3-69a3-485e-b8bd-a44a6b48918e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:03.344085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48f0a3-69a3-485e-b8bd-a44a6b48918e None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:03.344760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48f0a3-69a3-485e-b8bd-a44a6b48918e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:03.345060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48f0a3-69a3-485e-b8bd-a44a6b48918e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:03.346490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48f0a3-69a3-485e-b8bd-a44a6b48918e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:03.353258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 489/986] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:20:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:03.359858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f141f11-0ec7-4164-8794-ed21ddc55a02 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:03.530082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f141f11-0ec7-4164-8794-ed21ddc55a02 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:03.593869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ab0d4-dcdb-4586-a044-19b6e3bbea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:03.594455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ab0d4-dcdb-4586-a044-19b6e3bbea3e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:03.594760 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ab0d4-dcdb-4586-a044-19b6e3bbea3e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:03.595027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ab0d4-dcdb-4586-a044-19b6e3bbea3e None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:03.595664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ab0d4-dcdb-4586-a044-19b6e3bbea3e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:03.595961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ab0d4-dcdb-4586-a044-19b6e3bbea3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:03.597897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ab0d4-dcdb-4586-a044-19b6e3bbea3e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:03.604140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 498/987] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:20:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:03.610347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48f0a3-69a3-485e-b8bd-a44a6b48918e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:03.718994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48f0a3-69a3-485e-b8bd-a44a6b48918e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:03.734920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:03.756926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8846fbd-ea54-4ebc-842d-1fd64cb749b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:03.757532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8846fbd-ea54-4ebc-842d-1fd64cb749b6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:03.757802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8846fbd-ea54-4ebc-842d-1fd64cb749b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:03.758065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8846fbd-ea54-4ebc-842d-1fd64cb749b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:03.758805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8846fbd-ea54-4ebc-842d-1fd64cb749b6 None admin] RBAC: Adding query filter params (interface=admin, service_id=f259c46401bd417e8015dc0d9a0f52e1, region_id=RegionOne) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:03.759110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8846fbd-ea54-4ebc-842d-1fd64cb749b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:03.760467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8846fbd-ea54-4ebc-842d-1fd64cb749b6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:03.770691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 490/988] 10.222.0.78 () {56 vars in 1249 bytes} [Wed Aug 24 03:20:03 2022] GET /identity/v3/endpoints?service_id=f259c46401bd417e8015dc0d9a0f52e1&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:03.771731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ab0d4-dcdb-4586-a044-19b6e3bbea3e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:03.789274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:03.889117 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ab0d4-dcdb-4586-a044-19b6e3bbea3e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:03.937466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b87e6-d48f-4f39-91c2-7fcc38d980e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:03.938079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b87e6-d48f-4f39-91c2-7fcc38d980e5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:03.938349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b87e6-d48f-4f39-91c2-7fcc38d980e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:03.938608 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b87e6-d48f-4f39-91c2-7fcc38d980e5 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:03.939240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b87e6-d48f-4f39-91c2-7fcc38d980e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:03.941751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb94862-2606-46ec-8578-f639fa6b5ebd None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:03.942019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb94862-2606-46ec-8578-f639fa6b5ebd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:03.942284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb94862-2606-46ec-8578-f639fa6b5ebd None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:03.943670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b87e6-d48f-4f39-91c2-7fcc38d980e5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:03.943969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 491/989] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:03.951409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 499/990] 10.222.0.78 () {56 vars in 1087 bytes} [Wed Aug 24 03:20:03 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:20:03.953712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa9035-df1a-4b47-8d99-7a2787169244 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:03.954228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa9035-df1a-4b47-8d99-7a2787169244 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:03.954685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa9035-df1a-4b47-8d99-7a2787169244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:03.986332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8afa9035-df1a-4b47-8d99-7a2787169244 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:03.988450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8afa9035-df1a-4b47-8d99-7a2787169244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:04.097118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 492/991] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:04.387073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b87e6-d48f-4f39-91c2-7fcc38d980e5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:04.489442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7200d-0c3c-4b9c-8b2c-b4f11073b19e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:04.489716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7200d-0c3c-4b9c-8b2c-b4f11073b19e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:04.489819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:04.489983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7200d-0c3c-4b9c-8b2c-b4f11073b19e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:04.491849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 493/992] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:20:04.497995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890c75-af09-47c3-aa75-ef8a0ce72ea7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:04.498369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890c75-af09-47c3-aa75-ef8a0ce72ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:04.498607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890c75-af09-47c3-aa75-ef8a0ce72ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:04.514392 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b87e6-d48f-4f39-91c2-7fcc38d980e5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:04.521522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-78890c75-af09-47c3-aa75-ef8a0ce72ea7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:04.522821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-78890c75-af09-47c3-aa75-ef8a0ce72ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:04.556861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4c399-789a-4eed-97e0-3661dbd42d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:04.557609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c399-789a-4eed-97e0-3661dbd42d3f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:04.557874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c399-789a-4eed-97e0-3661dbd42d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:04.558150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c399-789a-4eed-97e0-3661dbd42d3f None admin] PATH_INFO: `/v3/services/image` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:04.558763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4c399-789a-4eed-97e0-3661dbd42d3f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:04.560139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4c399-789a-4eed-97e0-3661dbd42d3f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b2e4c399-789a-4eed-97e0-3661dbd42d3f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:04.569742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:04.571035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:04.571968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 500/993] 10.222.0.78 () {56 vars in 1105 bytes} [Wed Aug 24 03:20:04 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:04.577535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4c399-789a-4eed-97e0-3661dbd42d3f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:04.608268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 494/994] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:04.705883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4c399-789a-4eed-97e0-3661dbd42d3f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:04.745469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c0460-af8b-4632-907e-31ca979909d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:04.746223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c0460-af8b-4632-907e-31ca979909d1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:04.746505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c0460-af8b-4632-907e-31ca979909d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:04.746840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c0460-af8b-4632-907e-31ca979909d1 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:04.747490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c0460-af8b-4632-907e-31ca979909d1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:04.747789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c0460-af8b-4632-907e-31ca979909d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:04.749189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c0460-af8b-4632-907e-31ca979909d1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:04.755980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 501/995] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:04.761724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890c75-af09-47c3-aa75-ef8a0ce72ea7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:04.808739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:04.878399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890c75-af09-47c3-aa75-ef8a0ce72ea7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:04.885348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c0460-af8b-4632-907e-31ca979909d1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:04.889424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:04.921071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72938d-6eb4-4102-938b-d34174fdb61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:04.921947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72938d-6eb4-4102-938b-d34174fdb61d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:04.922366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72938d-6eb4-4102-938b-d34174fdb61d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:04.922920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72938d-6eb4-4102-938b-d34174fdb61d None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:04.923703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72938d-6eb4-4102-938b-d34174fdb61d None admin] RBAC: Adding query filter params (type=image) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:04.924112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72938d-6eb4-4102-938b-d34174fdb61d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:04.926188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72938d-6eb4-4102-938b-d34174fdb61d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:04.942758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 495/996] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:05.040504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c0460-af8b-4632-907e-31ca979909d1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:05.092011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41b341-820f-4e0d-9fc8-20510ed7cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:05.092676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b341-820f-4e0d-9fc8-20510ed7cb7d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:05.092940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b341-820f-4e0d-9fc8-20510ed7cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:05.093208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b341-820f-4e0d-9fc8-20510ed7cb7d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:05.093812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41b341-820f-4e0d-9fc8-20510ed7cb7d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:05.095267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41b341-820f-4e0d-9fc8-20510ed7cb7d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5e41b341-820f-4e0d-9fc8-20510ed7cb7d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:05.105693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:05.106788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:05.108042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 502/997] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:20:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:05.113039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72938d-6eb4-4102-938b-d34174fdb61d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:05.242265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72938d-6eb4-4102-938b-d34174fdb61d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:05.244223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:05.299518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49a48f-cb1a-4754-8a17-e080e7dca3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:05.300689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49a48f-cb1a-4754-8a17-e080e7dca3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:05.301324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49a48f-cb1a-4754-8a17-e080e7dca3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:05.301700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49a48f-cb1a-4754-8a17-e080e7dca3d2 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:05.302917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49a48f-cb1a-4754-8a17-e080e7dca3d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:05.303451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49a48f-cb1a-4754-8a17-e080e7dca3d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:05.306125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49a48f-cb1a-4754-8a17-e080e7dca3d2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:05.322856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 496/998] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:20:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:05.326568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41b341-820f-4e0d-9fc8-20510ed7cb7d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:05.444266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:05.507404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41b341-820f-4e0d-9fc8-20510ed7cb7d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:05.550601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f71c1-14a5-4520-9052-2947e95204da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:05.551138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f71c1-14a5-4520-9052-2947e95204da None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:05.551410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f71c1-14a5-4520-9052-2947e95204da None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:05.551665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f71c1-14a5-4520-9052-2947e95204da None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:05.552300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f71c1-14a5-4520-9052-2947e95204da None admin] RBAC: Adding query filter params (type=compute) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:05.552598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f71c1-14a5-4520-9052-2947e95204da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:05.553975 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f71c1-14a5-4520-9052-2947e95204da None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:05.560335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 503/999] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:20:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:05.566441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49a48f-cb1a-4754-8a17-e080e7dca3d2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:05.704242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49a48f-cb1a-4754-8a17-e080e7dca3d2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:05.742229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cbfb6-0c0d-46f6-ab65-eaa7e70d105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:05.742863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cbfb6-0c0d-46f6-ab65-eaa7e70d105c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:05.743137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cbfb6-0c0d-46f6-ab65-eaa7e70d105c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:05.743412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cbfb6-0c0d-46f6-ab65-eaa7e70d105c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:05.744109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cbfb6-0c0d-46f6-ab65-eaa7e70d105c None admin] RBAC: Adding query filter params (interface=public, service_id=59e245666735486e8bf8ea50ab377815, region_id=RegionOne) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:05.744420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cbfb6-0c0d-46f6-ab65-eaa7e70d105c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:05.745784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cbfb6-0c0d-46f6-ab65-eaa7e70d105c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:05.752338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 497/1000] 10.222.0.78 () {56 vars in 1251 bytes} [Wed Aug 24 03:20:05 2022] GET /identity/v3/endpoints?service_id=59e245666735486e8bf8ea50ab377815&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:05.758175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f71c1-14a5-4520-9052-2947e95204da None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:05.881714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f71c1-14a5-4520-9052-2947e95204da None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:05.916495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:05.932644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3191e-8d36-47ae-8bbd-3f3002a74ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:05.933286 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3191e-8d36-47ae-8bbd-3f3002a74ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:05.933559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3191e-8d36-47ae-8bbd-3f3002a74ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:05.933820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3191e-8d36-47ae-8bbd-3f3002a74ce8 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:05.934440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3191e-8d36-47ae-8bbd-3f3002a74ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:05.935880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3191e-8d36-47ae-8bbd-3f3002a74ce8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:05.944798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 504/1001] 10.222.0.78 () {56 vars in 1087 bytes} [Wed Aug 24 03:20:05 2022] GET /identity/v3/services => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:20:05.995038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696461e-5f4c-4aed-84f3-64b4d5d09999 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:05.995732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696461e-5f4c-4aed-84f3-64b4d5d09999 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:05.995732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696461e-5f4c-4aed-84f3-64b4d5d09999 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:05.997323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 498/1002] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:06.003464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dede5a7-281a-4feb-9ab2-228091466524 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:06.003844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dede5a7-281a-4feb-9ab2-228091466524 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:06.004033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dede5a7-281a-4feb-9ab2-228091466524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:06.025535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4dede5a7-281a-4feb-9ab2-228091466524 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:06.026858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4dede5a7-281a-4feb-9ab2-228091466524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:06.123342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 505/1003] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:06.391097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696461e-5f4c-4aed-84f3-64b4d5d09999 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:06.426963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:06.517723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696461e-5f4c-4aed-84f3-64b4d5d09999 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:06.560581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda81ef2-8f20-46c2-ab6f-4a84b837ab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:06.560977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda81ef2-8f20-46c2-ab6f-4a84b837ab07 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:06.561252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda81ef2-8f20-46c2-ab6f-4a84b837ab07 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:06.561518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda81ef2-8f20-46c2-ab6f-4a84b837ab07 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:06.562347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda81ef2-8f20-46c2-ab6f-4a84b837ab07 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:06.563551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda81ef2-8f20-46c2-ab6f-4a84b837ab07 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-fda81ef2-8f20-46c2-ab6f-4a84b837ab07 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:06.574010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:06.575525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:20:06.576939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:06.584051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 499/1004] 10.222.0.78 () {56 vars in 1126 bytes} [Wed Aug 24 03:20:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:06.584317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dede5a7-281a-4feb-9ab2-228091466524 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:06.708543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dede5a7-281a-4feb-9ab2-228091466524 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:06.741545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:06.755453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf791ef-f487-46a4-9362-cdccfe3d8aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:06.756087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf791ef-f487-46a4-9362-cdccfe3d8aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:06.756358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf791ef-f487-46a4-9362-cdccfe3d8aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:06.756624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf791ef-f487-46a4-9362-cdccfe3d8aa4 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:06.757275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf791ef-f487-46a4-9362-cdccfe3d8aa4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:06.757574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf791ef-f487-46a4-9362-cdccfe3d8aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:06.759002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf791ef-f487-46a4-9362-cdccfe3d8aa4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:06.765398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 506/1005] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:20:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:06.771431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda81ef2-8f20-46c2-ab6f-4a84b837ab07 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:06.887231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:06.892108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab345fb-d86e-42a1-a8db-0cbb39367603 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:06.892479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab345fb-d86e-42a1-a8db-0cbb39367603 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:06.892638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab345fb-d86e-42a1-a8db-0cbb39367603 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:06.894419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 507/1006] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:20:06.898452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda81ef2-8f20-46c2-ab6f-4a84b837ab07 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:06.899826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed224e77-3b7d-4881-a0d3-bd872dcac22a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:06.900158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed224e77-3b7d-4881-a0d3-bd872dcac22a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:06.900389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed224e77-3b7d-4881-a0d3-bd872dcac22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:06.927103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ed224e77-3b7d-4881-a0d3-bd872dcac22a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:06.929151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ed224e77-3b7d-4881-a0d3-bd872dcac22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:06.952781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b5f7-2ea1-4991-bdf3-03526bde0891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:06.953613 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b5f7-2ea1-4991-bdf3-03526bde0891 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:06.953920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b5f7-2ea1-4991-bdf3-03526bde0891 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:06.954168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b5f7-2ea1-4991-bdf3-03526bde0891 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:06.955281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469b5f7-2ea1-4991-bdf3-03526bde0891 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:06.955733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469b5f7-2ea1-4991-bdf3-03526bde0891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:06.957493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469b5f7-2ea1-4991-bdf3-03526bde0891 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:06.966543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 500/1007] 10.222.0.78 () {56 vars in 1122 bytes} [Wed Aug 24 03:20:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:06.972112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b5f7-2ea1-4991-bdf3-03526bde0891 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:07.026692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 508/1008] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:07.111665 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b5f7-2ea1-4991-bdf3-03526bde0891 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:07.148683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aaae0-683a-4e6a-8b9e-5e35a65d2aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:07.149419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aaae0-683a-4e6a-8b9e-5e35a65d2aa8 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:07.149749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aaae0-683a-4e6a-8b9e-5e35a65d2aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:07.150109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aaae0-683a-4e6a-8b9e-5e35a65d2aa8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:07.150819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aaae0-683a-4e6a-8b9e-5e35a65d2aa8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:07.152182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aaae0-683a-4e6a-8b9e-5e35a65d2aa8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:07.172015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 501/1009] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:20:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:20:07.301254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed224e77-3b7d-4881-a0d3-bd872dcac22a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:07.419764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed224e77-3b7d-4881-a0d3-bd872dcac22a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:07.445881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:07.469912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4886a-7582-4c60-ba84-dccd6241e34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:07.470531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4886a-7582-4c60-ba84-dccd6241e34d None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:07.470833 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4886a-7582-4c60-ba84-dccd6241e34d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:07.471222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4886a-7582-4c60-ba84-dccd6241e34d None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:07.472641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4886a-7582-4c60-ba84-dccd6241e34d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:07.474028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4886a-7582-4c60-ba84-dccd6241e34d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:07.491469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 509/1010] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:20:07 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:20:08.070203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35f24b-f49e-405b-b970-3ee6a9cd8c5e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:08.070601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35f24b-f49e-405b-b970-3ee6a9cd8c5e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:08.070824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35f24b-f49e-405b-b970-3ee6a9cd8c5e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:08.072629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 502/1011] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:08.078257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d887f01-8984-4cea-8d70-6f91731a5951 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:08.078883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d887f01-8984-4cea-8d70-6f91731a5951 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:08.078883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d887f01-8984-4cea-8d70-6f91731a5951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:08.099289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4d887f01-8984-4cea-8d70-6f91731a5951 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:08.100778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4d887f01-8984-4cea-8d70-6f91731a5951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:08.190780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 510/1012] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:08 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:08.461015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35f24b-f49e-405b-b970-3ee6a9cd8c5e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:08.483852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:08.581396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35f24b-f49e-405b-b970-3ee6a9cd8c5e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:08.626565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae26e2-4ebc-4284-a7d5-5afe305eb0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:08.627295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae26e2-4ebc-4284-a7d5-5afe305eb0fd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:08.627605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae26e2-4ebc-4284-a7d5-5afe305eb0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:08.628067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae26e2-4ebc-4284-a7d5-5afe305eb0fd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:08.628863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae26e2-4ebc-4284-a7d5-5afe305eb0fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:08.630271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae26e2-4ebc-4284-a7d5-5afe305eb0fd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-b6ae26e2-4ebc-4284-a7d5-5afe305eb0fd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:08.640406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:08.646726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:08.647579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 503/1013] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:20:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:08.649168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d887f01-8984-4cea-8d70-6f91731a5951 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:08.772932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d887f01-8984-4cea-8d70-6f91731a5951 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:08.774519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:08.819187 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d3752-119a-46df-ac9c-84d6cdaf699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:08.819821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d3752-119a-46df-ac9c-84d6cdaf699e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:08.820088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d3752-119a-46df-ac9c-84d6cdaf699e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:08.820358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d3752-119a-46df-ac9c-84d6cdaf699e None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:08.821003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d3752-119a-46df-ac9c-84d6cdaf699e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:08.821300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d3752-119a-46df-ac9c-84d6cdaf699e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:08.823081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d3752-119a-46df-ac9c-84d6cdaf699e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:08.828941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 511/1014] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:20:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:08.834623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae26e2-4ebc-4284-a7d5-5afe305eb0fd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:08.952802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:08.979191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae26e2-4ebc-4284-a7d5-5afe305eb0fd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:09.035738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690e5c9-b4a6-46f0-9867-583bae28bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:09.037370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690e5c9-b4a6-46f0-9867-583bae28bb1f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:09.037370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690e5c9-b4a6-46f0-9867-583bae28bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:09.037565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690e5c9-b4a6-46f0-9867-583bae28bb1f None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:09.042291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690e5c9-b4a6-46f0-9867-583bae28bb1f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:09.042291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690e5c9-b4a6-46f0-9867-583bae28bb1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:09.042291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690e5c9-b4a6-46f0-9867-583bae28bb1f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:09.055961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 504/1015] 10.222.0.78 () {56 vars in 1112 bytes} [Wed Aug 24 03:20:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:09.057091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d3752-119a-46df-ac9c-84d6cdaf699e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:09.176336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97c4d-890c-4d4f-a0da-c877e464594a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:09.176600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97c4d-890c-4d4f-a0da-c877e464594a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:09.176939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97c4d-890c-4d4f-a0da-c877e464594a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:09.178231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 505/1016] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:20:09.184028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6072c-8589-4e9d-99de-28f4519e38cc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:09.184309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6072c-8589-4e9d-99de-28f4519e38cc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:09.184575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6072c-8589-4e9d-99de-28f4519e38cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:09.199441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d3752-119a-46df-ac9c-84d6cdaf699e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:09.205642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-aad6072c-8589-4e9d-99de-28f4519e38cc None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:09.207873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-aad6072c-8589-4e9d-99de-28f4519e38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:09.259664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deebf7-8d4d-477d-9feb-7179135d3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:09.260674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deebf7-8d4d-477d-9feb-7179135d3d4b None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:09.261152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deebf7-8d4d-477d-9feb-7179135d3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:09.261644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deebf7-8d4d-477d-9feb-7179135d3d4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:09.262424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deebf7-8d4d-477d-9feb-7179135d3d4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:09.263978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deebf7-8d4d-477d-9feb-7179135d3d4b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:09.289357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 506/1017] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:09 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:09.306688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 512/1018] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:20:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:20:09.536308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8f8e-9f36-4422-8d9b-f541e32946e6 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:09.536853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8f8e-9f36-4422-8d9b-f541e32946e6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:09.536853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8f8e-9f36-4422-8d9b-f541e32946e6 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:09.538452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 507/1019] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:09.544336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f1f11-aad6-400e-9588-78940695a033 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:09.544549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f1f11-aad6-400e-9588-78940695a033 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:09.544817 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f1f11-aad6-400e-9588-78940695a033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:09.563495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8f8e-9f36-4422-8d9b-f541e32946e6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:09.564493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ad5f1f11-aad6-400e-9588-78940695a033 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:09.565791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ad5f1f11-aad6-400e-9588-78940695a033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:09.591025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:09.669986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 513/1020] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:09.683520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:09.719067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8f8e-9f36-4422-8d9b-f541e32946e6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:09.782421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b676f-7080-4b3a-89ea-4d6327b0f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:09.784030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b676f-7080-4b3a-89ea-4d6327b0f431 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:09.784513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b676f-7080-4b3a-89ea-4d6327b0f431 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:09.784999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b676f-7080-4b3a-89ea-4d6327b0f431 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:09.787033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b676f-7080-4b3a-89ea-4d6327b0f431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:09.790004 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b676f-7080-4b3a-89ea-4d6327b0f431 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:09.794809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 508/1021] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:09.799922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f1f11-aad6-400e-9588-78940695a033 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:09.933320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f1f11-aad6-400e-9588-78940695a033 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:09.937415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b676f-7080-4b3a-89ea-4d6327b0f431 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:09.975271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcb8f6-5773-4f66-be34-4b26efbc12c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:09.976152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb8f6-5773-4f66-be34-4b26efbc12c6 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:09.976567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb8f6-5773-4f66-be34-4b26efbc12c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:09.976992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb8f6-5773-4f66-be34-4b26efbc12c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:09.978731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcb8f6-5773-4f66-be34-4b26efbc12c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:09.980257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcb8f6-5773-4f66-be34-4b26efbc12c6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:10.004802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:10.017448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 514/1022] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:20:09 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:20:10.076326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b676f-7080-4b3a-89ea-4d6327b0f431 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:10.121892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fba11-40f7-4e2a-ab62-4627b922fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:10.122620 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fba11-40f7-4e2a-ab62-4627b922fd4f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:10.122919 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fba11-40f7-4e2a-ab62-4627b922fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:10.123194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fba11-40f7-4e2a-ab62-4627b922fd4f None admin] PATH_INFO: `/v3/services/image` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:10.123864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fba11-40f7-4e2a-ab62-4627b922fd4f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:10.125306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fba11-40f7-4e2a-ab62-4627b922fd4f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-353fba11-40f7-4e2a-ab62-4627b922fd4f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:10.136143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:10.137212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:20:10.138119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:10.142826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 509/1023] 10.222.0.78 () {56 vars in 1105 bytes} [Wed Aug 24 03:20:09 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:10.144259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcb8f6-5773-4f66-be34-4b26efbc12c6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:10.289654 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcb8f6-5773-4f66-be34-4b26efbc12c6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:10.331232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1861f-9495-4a5b-91e3-e8fb5acd7676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:10.331431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1861f-9495-4a5b-91e3-e8fb5acd7676 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:10.331679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1861f-9495-4a5b-91e3-e8fb5acd7676 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:10.332135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1861f-9495-4a5b-91e3-e8fb5acd7676 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:10.333069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1861f-9495-4a5b-91e3-e8fb5acd7676 None admin] RBAC: Adding query filter params (name=image) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:10.333425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1861f-9495-4a5b-91e3-e8fb5acd7676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:10.334873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1861f-9495-4a5b-91e3-e8fb5acd7676 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:10.340612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 515/1024] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:10.346464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fba11-40f7-4e2a-ab62-4627b922fd4f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:10.358471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:10.472978 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fba11-40f7-4e2a-ab62-4627b922fd4f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:10.515099 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d163ae4-7948-4476-9085-5a3ad82638f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:10.515701 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d163ae4-7948-4476-9085-5a3ad82638f5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:10.515985 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d163ae4-7948-4476-9085-5a3ad82638f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:10.516236 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d163ae4-7948-4476-9085-5a3ad82638f5 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:10.516877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d163ae4-7948-4476-9085-5a3ad82638f5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:10.517185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d163ae4-7948-4476-9085-5a3ad82638f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:10.519396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d163ae4-7948-4476-9085-5a3ad82638f5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:10.530792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 510/1025] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:10.532938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1861f-9495-4a5b-91e3-e8fb5acd7676 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:10.631244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:10.680436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1861f-9495-4a5b-91e3-e8fb5acd7676 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:10.718328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661c26-6d77-44b1-9708-a32040d5d32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:10.718993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661c26-6d77-44b1-9708-a32040d5d32e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:10.719260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661c26-6d77-44b1-9708-a32040d5d32e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:10.719533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661c26-6d77-44b1-9708-a32040d5d32e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:10.720268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661c26-6d77-44b1-9708-a32040d5d32e None admin] RBAC: Adding query filter params (interface=public, service_id=3651553e73204fe191ed9d11a1a2b443, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:10.720576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661c26-6d77-44b1-9708-a32040d5d32e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:10.722361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661c26-6d77-44b1-9708-a32040d5d32e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:10.730852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 516/1026] 10.222.0.78 () {56 vars in 1251 bytes} [Wed Aug 24 03:20:10 2022] GET /identity/v3/endpoints?service_id=3651553e73204fe191ed9d11a1a2b443&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:10.734731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d163ae4-7948-4476-9085-5a3ad82638f5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:10.822046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:10.866623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d163ae4-7948-4476-9085-5a3ad82638f5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:10.903899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081480-acda-4999-bdb2-ea773ff8c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:10.904562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081480-acda-4999-bdb2-ea773ff8c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:10.904890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081480-acda-4999-bdb2-ea773ff8c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:10.905507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081480-acda-4999-bdb2-ea773ff8c0e0 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:10.906326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74081480-acda-4999-bdb2-ea773ff8c0e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:10.907810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74081480-acda-4999-bdb2-ea773ff8c0e0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:10.923111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 511/1027] 10.222.0.78 () {56 vars in 1087 bytes} [Wed Aug 24 03:20:10 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:20:11.381618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd71a10-a1ee-4554-8243-acf31a5ef28a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:11.382307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd71a10-a1ee-4554-8243-acf31a5ef28a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:11.382307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd71a10-a1ee-4554-8243-acf31a5ef28a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:11.383577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 517/1028] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:11.390089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87c76-63a1-492c-a06a-102c4a063136 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:11.390608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87c76-63a1-492c-a06a-102c4a063136 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:11.390918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87c76-63a1-492c-a06a-102c4a063136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:11.412108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5ca87c76-63a1-492c-a06a-102c4a063136 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:11.413312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5ca87c76-63a1-492c-a06a-102c4a063136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:11.491140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 512/1029] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:11.763589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd71a10-a1ee-4554-8243-acf31a5ef28a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:11.897854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd71a10-a1ee-4554-8243-acf31a5ef28a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:11.935142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:11.949645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061552-8d41-46b9-9615-92579f461216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:11.950319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061552-8d41-46b9-9615-92579f461216 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:11.950568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061552-8d41-46b9-9615-92579f461216 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:11.950866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061552-8d41-46b9-9615-92579f461216 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:11.966913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3061552-8d41-46b9-9615-92579f461216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e3061552-8d41-46b9-9615-92579f461216 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:20:11.972067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:11.973059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:11.975642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 518/1030] 10.222.0.78 () {56 vars in 1120 bytes} [Wed Aug 24 03:20:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:11.980887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87c76-63a1-492c-a06a-102c4a063136 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:12.073534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:12.114818 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136120-9d09-413f-8963-baa7bfbd8f3f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.115502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136120-9d09-413f-8963-baa7bfbd8f3f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.115970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136120-9d09-413f-8963-baa7bfbd8f3f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.118057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 519/1031] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:12.124097 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cd759-0084-4bf1-a305-2ec70ab98a8a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.124379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cd759-0084-4bf1-a305-2ec70ab98a8a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.124660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cd759-0084-4bf1-a305-2ec70ab98a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.126881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87c76-63a1-492c-a06a-102c4a063136 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:12.151950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cf7cd759-0084-4bf1-a305-2ec70ab98a8a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:12.153205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cf7cd759-0084-4bf1-a305-2ec70ab98a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:12.169321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc873e-4232-453a-949e-f141060f1fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:12.170462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc873e-4232-453a-949e-f141060f1fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.171464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc873e-4232-453a-949e-f141060f1fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.171946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc873e-4232-453a-949e-f141060f1fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.173087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc873e-4232-453a-949e-f141060f1fa6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:12.173606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc873e-4232-453a-949e-f141060f1fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:12.176086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc873e-4232-453a-949e-f141060f1fa6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:12.188768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 513/1032] 10.222.0.78 () {56 vars in 1115 bytes} [Wed Aug 24 03:20:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:12.195060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc873e-4232-453a-949e-f141060f1fa6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:12.239789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 520/1033] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:12.335635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc873e-4232-453a-949e-f141060f1fa6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:12.372582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:12.387078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7a8ab-e899-434e-a5a6-3ea009774fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:12.387727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7a8ab-e899-434e-a5a6-3ea009774fda None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.388001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7a8ab-e899-434e-a5a6-3ea009774fda None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.388268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7a8ab-e899-434e-a5a6-3ea009774fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.402412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7a8ab-e899-434e-a5a6-3ea009774fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:12.403913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7a8ab-e899-434e-a5a6-3ea009774fda None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-16c7a8ab-e899-434e-a5a6-3ea009774fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:20:12.421265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:12.422297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:20:12.423190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:20:12.423190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:12.423190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:12.427068 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 514/1034] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:12.429378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cd759-0084-4bf1-a305-2ec70ab98a8a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:12.517227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7a8ab-e899-434e-a5a6-3ea009774fda None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:12.556760 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cd759-0084-4bf1-a305-2ec70ab98a8a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:12.592368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:12.622184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1af7-2e88-4cc1-b42f-48348e00cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:12.623357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1af7-2e88-4cc1-b42f-48348e00cc34 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.623807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1af7-2e88-4cc1-b42f-48348e00cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.624225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1af7-2e88-4cc1-b42f-48348e00cc34 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.625173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa1af7-2e88-4cc1-b42f-48348e00cc34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:12.626039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa1af7-2e88-4cc1-b42f-48348e00cc34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:12.628140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa1af7-2e88-4cc1-b42f-48348e00cc34 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:12.644380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 521/1035] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:12.646598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7a8ab-e899-434e-a5a6-3ea009774fda None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:12.649742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1af7-2e88-4cc1-b42f-48348e00cc34 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:12.690529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ccf8d-fb13-41f3-a4d2-825690c91cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:12.692008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ccf8d-fb13-41f3-a4d2-825690c91cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.692576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ccf8d-fb13-41f3-a4d2-825690c91cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.693050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ccf8d-fb13-41f3-a4d2-825690c91cc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.694404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ccf8d-fb13-41f3-a4d2-825690c91cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:12.695944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ccf8d-fb13-41f3-a4d2-825690c91cc3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:12.703182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 515/1036] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:12.704547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ccf8d-fb13-41f3-a4d2-825690c91cc3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:12.769996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:12.792088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1af7-2e88-4cc1-b42f-48348e00cc34 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:12.839368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e49de-3ae0-4152-a690-9b220c90f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:12.840030 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e49de-3ae0-4152-a690-9b220c90f7bf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.840308 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e49de-3ae0-4152-a690-9b220c90f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.840575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e49de-3ae0-4152-a690-9b220c90f7bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.840783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ccf8d-fb13-41f3-a4d2-825690c91cc3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:12.849787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e49de-3ae0-4152-a690-9b220c90f7bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:12.851213 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e49de-3ae0-4152-a690-9b220c90f7bf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-cb8e49de-3ae0-4152-a690-9b220c90f7bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:20:12.863843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:12.864888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:12.865823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 522/1037] 10.222.0.78 () {56 vars in 1093 bytes} [Wed Aug 24 03:20:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:12.879221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e49de-3ae0-4152-a690-9b220c90f7bf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:12.897558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e2749-1c52-4e69-8fa3-ca81a52de6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:12.898224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2749-1c52-4e69-8fa3-ca81a52de6e0 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.898497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2749-1c52-4e69-8fa3-ca81a52de6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.898808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2749-1c52-4e69-8fa3-ca81a52de6e0 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.899469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e2749-1c52-4e69-8fa3-ca81a52de6e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:12.900903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e2749-1c52-4e69-8fa3-ca81a52de6e0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:12.924226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 516/1038] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:20:12 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:20:12.926141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b94c1-4839-46e4-a614-f8c5431d9c27 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.926531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b94c1-4839-46e4-a614-f8c5431d9c27 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.926937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b94c1-4839-46e4-a614-f8c5431d9c27 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.928372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 517/1039] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:12.934599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64731b-6008-469c-8774-91cd896414f3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:12.934942 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64731b-6008-469c-8774-91cd896414f3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:12.935156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64731b-6008-469c-8774-91cd896414f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:12.944841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:12.955640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3f64731b-6008-469c-8774-91cd896414f3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:12.957417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3f64731b-6008-469c-8774-91cd896414f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:13.032022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e49de-3ae0-4152-a690-9b220c90f7bf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:13.068480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 518/1040] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:13.076541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e857-81ad-4569-9e79-78dd59bc4f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:13.077332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e857-81ad-4569-9e79-78dd59bc4f8e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:13.077725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e857-81ad-4569-9e79-78dd59bc4f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:13.078121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e857-81ad-4569-9e79-78dd59bc4f8e None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:13.079052 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e857-81ad-4569-9e79-78dd59bc4f8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:13.079473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e857-81ad-4569-9e79-78dd59bc4f8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:13.081233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e857-81ad-4569-9e79-78dd59bc4f8e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:13.103108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 523/1041] 10.222.0.78 () {56 vars in 1133 bytes} [Wed Aug 24 03:20:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:13.108570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64731b-6008-469c-8774-91cd896414f3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:13.148474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:13.231682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64731b-6008-469c-8774-91cd896414f3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:13.277736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f8caa-4f6a-4414-8595-c0b00c202895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:13.278466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f8caa-4f6a-4414-8595-c0b00c202895 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:13.278767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f8caa-4f6a-4414-8595-c0b00c202895 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:13.279035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f8caa-4f6a-4414-8595-c0b00c202895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:13.353404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e857-81ad-4569-9e79-78dd59bc4f8e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:13.373581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f8caa-4f6a-4414-8595-c0b00c202895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:13.375134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f8caa-4f6a-4414-8595-c0b00c202895 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:13.422598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:13.484954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:13.495922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e857-81ad-4569-9e79-78dd59bc4f8e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:13.525341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 519/1042] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:13 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:13.531742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f8caa-4f6a-4414-8595-c0b00c202895 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:13.535033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045e4ef-3bf6-4370-8cd7-8d2232c0de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:13.536703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045e4ef-3bf6-4370-8cd7-8d2232c0de99 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:13.536989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045e4ef-3bf6-4370-8cd7-8d2232c0de99 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:13.537259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045e4ef-3bf6-4370-8cd7-8d2232c0de99 None admin] PATH_INFO: `/v3/services/image` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:13.537876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045e4ef-3bf6-4370-8cd7-8d2232c0de99 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:13.539335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045e4ef-3bf6-4370-8cd7-8d2232c0de99 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-4045e4ef-3bf6-4370-8cd7-8d2232c0de99 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:13.550277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:13.555378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:13.556226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 524/1043] 10.222.0.78 () {56 vars in 1105 bytes} [Wed Aug 24 03:20:13 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:13.557848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045e4ef-3bf6-4370-8cd7-8d2232c0de99 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:13.656803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f8caa-4f6a-4414-8595-c0b00c202895 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:13.681207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045e4ef-3bf6-4370-8cd7-8d2232c0de99 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:13.706715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe995a-f1d0-48f0-8676-21e35f14aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:13.707708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe995a-f1d0-48f0-8676-21e35f14aa21 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:13.708172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe995a-f1d0-48f0-8676-21e35f14aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:13.708515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe995a-f1d0-48f0-8676-21e35f14aa21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:13.711441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:13.722671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe995a-f1d0-48f0-8676-21e35f14aa21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:13.724163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe995a-f1d0-48f0-8676-21e35f14aa21 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:13.729765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8808fe-b518-4a36-b7d6-6b7efa477bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:13.730385 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8808fe-b518-4a36-b7d6-6b7efa477bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:13.730845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8808fe-b518-4a36-b7d6-6b7efa477bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:13.730965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8808fe-b518-4a36-b7d6-6b7efa477bd0 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:13.731603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8808fe-b518-4a36-b7d6-6b7efa477bd0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:13.731907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8808fe-b518-4a36-b7d6-6b7efa477bd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:13.733274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8808fe-b518-4a36-b7d6-6b7efa477bd0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:13.738534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 525/1044] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-77fe995a-f1d0-48f0-8676-21e35f14aa21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:20:13.740868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:13.742000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:20:13.743190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:20:13.743190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:13.743190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:13.744284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8808fe-b518-4a36-b7d6-6b7efa477bd0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:13.745136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 520/1045] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:13.750691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe995a-f1d0-48f0-8676-21e35f14aa21 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:13.779885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:13.873640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8808fe-b518-4a36-b7d6-6b7efa477bd0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:13.882225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe995a-f1d0-48f0-8676-21e35f14aa21 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:13.923585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918555c5-cf8e-4951-853a-9e0915f06611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:13.926372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918555c5-cf8e-4951-853a-9e0915f06611 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:13.926372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918555c5-cf8e-4951-853a-9e0915f06611 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:13.926372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918555c5-cf8e-4951-853a-9e0915f06611 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:13.926372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918555c5-cf8e-4951-853a-9e0915f06611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:13.926372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918555c5-cf8e-4951-853a-9e0915f06611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:13.927271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918555c5-cf8e-4951-853a-9e0915f06611 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:13.942137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92b30-edf5-47d2-9c11-06a25d189f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:13.950553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 521/1046] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:13.950788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92b30-edf5-47d2-9c11-06a25d189f35 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:13.950788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92b30-edf5-47d2-9c11-06a25d189f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:13.950788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92b30-edf5-47d2-9c11-06a25d189f35 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:13.950788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e92b30-edf5-47d2-9c11-06a25d189f35 None admin] RBAC: Adding query filter params (type=image) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:13.950788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e92b30-edf5-47d2-9c11-06a25d189f35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:13.950788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e92b30-edf5-47d2-9c11-06a25d189f35 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:13.953597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918555c5-cf8e-4951-853a-9e0915f06611 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:13.959459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 526/1047] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:13.971547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92b30-edf5-47d2-9c11-06a25d189f35 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:14.013514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:14.078881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918555c5-cf8e-4951-853a-9e0915f06611 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:14.121227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993371e-0319-4cea-9b23-cc756c964dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:14.121874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993371e-0319-4cea-9b23-cc756c964dbc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:14.122156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993371e-0319-4cea-9b23-cc756c964dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:14.122532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993371e-0319-4cea-9b23-cc756c964dbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:14.131563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993371e-0319-4cea-9b23-cc756c964dbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:14.132953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993371e-0319-4cea-9b23-cc756c964dbc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:14.140437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-d993371e-0319-4cea-9b23-cc756c964dbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:20:14.152625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:14.154450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:14.164618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:20:14.164618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:20:14.164618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:20:14.164618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:20:14.164618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:20:14.164618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:20:14.164618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:20:14.164618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:14.164618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 522/1048] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:20:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:14.167896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993371e-0319-4cea-9b23-cc756c964dbc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:14.170384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92b30-edf5-47d2-9c11-06a25d189f35 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:14.212314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5ce72-fa85-4488-b86f-1ab38a05b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:14.213044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5ce72-fa85-4488-b86f-1ab38a05b572 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:14.213463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5ce72-fa85-4488-b86f-1ab38a05b572 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:14.213870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5ce72-fa85-4488-b86f-1ab38a05b572 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:14.214915 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5ce72-fa85-4488-b86f-1ab38a05b572 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:14.217055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5ce72-fa85-4488-b86f-1ab38a05b572 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:14.254478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 527/1049] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:20:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:20:14.380529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993371e-0319-4cea-9b23-cc756c964dbc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:14.394439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:14.458560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed55e49-0b26-4b5f-a266-85c0d77273b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:14.459614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed55e49-0b26-4b5f-a266-85c0d77273b7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:14.460018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed55e49-0b26-4b5f-a266-85c0d77273b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:14.460407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed55e49-0b26-4b5f-a266-85c0d77273b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:14.461286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed55e49-0b26-4b5f-a266-85c0d77273b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:14.461723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed55e49-0b26-4b5f-a266-85c0d77273b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:14.463887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed55e49-0b26-4b5f-a266-85c0d77273b7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:14.484721 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 523/1050] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:14.492553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5ce72-fa85-4488-b86f-1ab38a05b572 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:14.687363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5ce72-fa85-4488-b86f-1ab38a05b572 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:14.754762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17508c-2765-45e6-8e09-174cb7b19b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:14.755759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17508c-2765-45e6-8e09-174cb7b19b7a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:14.756166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17508c-2765-45e6-8e09-174cb7b19b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:14.756563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17508c-2765-45e6-8e09-174cb7b19b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:14.757700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17508c-2765-45e6-8e09-174cb7b19b7a None admin] RBAC: Adding query filter params (role.id=8d116fbf411c4e1f88d93f56486ef2fb, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=438786dead414066a6ef101a2493fb8c) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:14.758177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17508c-2765-45e6-8e09-174cb7b19b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:14.760548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17508c-2765-45e6-8e09-174cb7b19b7a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:14.774697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 528/1051] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:20:14 2022] GET /identity/v3/role_assignments?user.id=438786dead414066a6ef101a2493fb8c&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=8d116fbf411c4e1f88d93f56486ef2fb => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:15.163961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b4c30-16e4-4ce0-a18a-de14cf51ac96 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:15.164489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b4c30-16e4-4ce0-a18a-de14cf51ac96 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:15.164827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b4c30-16e4-4ce0-a18a-de14cf51ac96 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:15.167434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 524/1052] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:15.173399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcb7fd-c799-4846-9dce-f0157499f94d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:15.173676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcb7fd-c799-4846-9dce-f0157499f94d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:15.174087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcb7fd-c799-4846-9dce-f0157499f94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:15.195852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-19fcb7fd-c799-4846-9dce-f0157499f94d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:15.197077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-19fcb7fd-c799-4846-9dce-f0157499f94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:15.200353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:15.321482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 529/1053] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:15.805907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b4c30-16e4-4ce0-a18a-de14cf51ac96 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:16.013839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b4c30-16e4-4ce0-a18a-de14cf51ac96 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:16.082705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37bd74-3eba-454e-82f3-9836b878e320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:16.083822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37bd74-3eba-454e-82f3-9836b878e320 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:16.084314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37bd74-3eba-454e-82f3-9836b878e320 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:16.084769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37bd74-3eba-454e-82f3-9836b878e320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:16.106578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37bd74-3eba-454e-82f3-9836b878e320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ae37bd74-3eba-454e-82f3-9836b878e320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:20:16.117429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:16.118399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:16.119604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:16.123024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 525/1054] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:20:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:16.130509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcb7fd-c799-4846-9dce-f0157499f94d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:16.251609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcb7fd-c799-4846-9dce-f0157499f94d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:16.290838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac6f2a-7505-4eb6-9cb9-5bad8c4348e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:16.291354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac6f2a-7505-4eb6-9cb9-5bad8c4348e5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:16.291624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac6f2a-7505-4eb6-9cb9-5bad8c4348e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:16.291867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac6f2a-7505-4eb6-9cb9-5bad8c4348e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:16.292540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac6f2a-7505-4eb6-9cb9-5bad8c4348e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:16.292832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac6f2a-7505-4eb6-9cb9-5bad8c4348e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:16.294204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac6f2a-7505-4eb6-9cb9-5bad8c4348e5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:16.300573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:16.305787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba7162-5cb7-4dec-a3f4-570a05cbf162 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:16.306352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba7162-5cb7-4dec-a3f4-570a05cbf162 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:16.306352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba7162-5cb7-4dec-a3f4-570a05cbf162 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:16.307938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 526/1055] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:16.309380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 530/1056] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:20:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:16.315513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac6f2a-7505-4eb6-9cb9-5bad8c4348e5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:16.315818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a153d-1d8e-49f9-b240-45faaf2d9cd9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:16.316081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a153d-1d8e-49f9-b240-45faaf2d9cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:16.316364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a153d-1d8e-49f9-b240-45faaf2d9cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:16.347284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3b0a153d-1d8e-49f9-b240-45faaf2d9cd9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:16.349668 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3b0a153d-1d8e-49f9-b240-45faaf2d9cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:16.383132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:16.438185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac6f2a-7505-4eb6-9cb9-5bad8c4348e5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:16.445492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 527/1057] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:16.476167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e219f3-48f6-4af9-bff1-ed2b760d540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:16.476800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e219f3-48f6-4af9-bff1-ed2b760d540e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:16.477072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e219f3-48f6-4af9-bff1-ed2b760d540e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:16.477335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e219f3-48f6-4af9-bff1-ed2b760d540e None admin] PATH_INFO: `/v3/users/1c73c580e4434ce99cf2b366c1f44e92` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:16.492570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e219f3-48f6-4af9-bff1-ed2b760d540e None admin] RBAC: Authorizing `identity:get_user(user_id=1c73c580e4434ce99cf2b366c1f44e92)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:16.494022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e219f3-48f6-4af9-bff1-ed2b760d540e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:16.500645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 531/1058] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:16 2022] GET /identity/v3/users/1c73c580e4434ce99cf2b366c1f44e92 => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:16.501775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a153d-1d8e-49f9-b240-45faaf2d9cd9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:16.651134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a153d-1d8e-49f9-b240-45faaf2d9cd9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:16.720515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e219f3-48f6-4af9-bff1-ed2b760d540e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:16.722481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f10c15-7cc1-464b-9d36-bde1c480b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:16.723535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f10c15-7cc1-464b-9d36-bde1c480b823 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:16.724009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f10c15-7cc1-464b-9d36-bde1c480b823 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:16.724478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f10c15-7cc1-464b-9d36-bde1c480b823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:16.764505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:16.807530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:16.836674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f10c15-7cc1-464b-9d36-bde1c480b823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:16.838370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f10c15-7cc1-464b-9d36-bde1c480b823 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:16.894009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e219f3-48f6-4af9-bff1-ed2b760d540e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:16.961737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90636c69-0c47-4753-9e48-59005175aeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:16.962774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90636c69-0c47-4753-9e48-59005175aeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:16.963231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90636c69-0c47-4753-9e48-59005175aeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:16.963688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90636c69-0c47-4753-9e48-59005175aeb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:16.973552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 528/1059] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:16.979842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f10c15-7cc1-464b-9d36-bde1c480b823 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:17.063694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:17.092868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90636c69-0c47-4753-9e48-59005175aeb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:17.095619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90636c69-0c47-4753-9e48-59005175aeb9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:17.126423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f10c15-7cc1-464b-9d36-bde1c480b823 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:17.188926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f45418-60e0-41ac-ba11-1cf860e53599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:17.190075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f45418-60e0-41ac-ba11-1cf860e53599 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:17.190554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f45418-60e0-41ac-ba11-1cf860e53599 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:17.191065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f45418-60e0-41ac-ba11-1cf860e53599 None admin] PATH_INFO: `/v3/projects/5a70d39744774b4f8bab2e59c3620aef` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:17.193152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f45418-60e0-41ac-ba11-1cf860e53599 None admin] RBAC: Authorizing `identity:get_project(project_id=5a70d39744774b4f8bab2e59c3620aef)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:17.195923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f45418-60e0-41ac-ba11-1cf860e53599 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:17.200405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 529/1060] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:20:16 2022] GET /identity/v3/projects/5a70d39744774b4f8bab2e59c3620aef => generated 311 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:17.207067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f45418-60e0-41ac-ba11-1cf860e53599 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:17.225422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:17.280553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 532/1061] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:20:17.281869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7445-c818-4303-9c3b-6a0bc82f224c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:17.282141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7445-c818-4303-9c3b-6a0bc82f224c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:17.282474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7445-c818-4303-9c3b-6a0bc82f224c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:17.285036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 533/1062] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:17.288933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa7445-c818-4303-9c3b-6a0bc82f224c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:17.357330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f45418-60e0-41ac-ba11-1cf860e53599 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:17.387227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:17.409648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d82bbf-cbcc-43a6-8621-dc74e57f2396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:17.410442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d82bbf-cbcc-43a6-8621-dc74e57f2396 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:17.410885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d82bbf-cbcc-43a6-8621-dc74e57f2396 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:17.411253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d82bbf-cbcc-43a6-8621-dc74e57f2396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:17.412022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d82bbf-cbcc-43a6-8621-dc74e57f2396 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=5a70d39744774b4f8bab2e59c3620aef, user.id=1c73c580e4434ce99cf2b366c1f44e92) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:17.412393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d82bbf-cbcc-43a6-8621-dc74e57f2396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:17.414268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d82bbf-cbcc-43a6-8621-dc74e57f2396 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:17.430983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 530/1063] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:20:17 2022] GET /identity/v3/role_assignments?user.id=1c73c580e4434ce99cf2b366c1f44e92&scope.project.id=5a70d39744774b4f8bab2e59c3620aef&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:17.430983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee220d-51be-4943-8da4-b32e1cde2117 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:17.430983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee220d-51be-4943-8da4-b32e1cde2117 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:17.430983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee220d-51be-4943-8da4-b32e1cde2117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:17.444824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa7445-c818-4303-9c3b-6a0bc82f224c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:17.453508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-caee220d-51be-4943-8da4-b32e1cde2117 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:17.455516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-caee220d-51be-4943-8da4-b32e1cde2117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:17.517402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311ebbc-69f6-462f-8da3-57d781a416f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:17.518857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311ebbc-69f6-462f-8da3-57d781a416f2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:17.519446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311ebbc-69f6-462f-8da3-57d781a416f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:17.519918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311ebbc-69f6-462f-8da3-57d781a416f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:17.547756 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311ebbc-69f6-462f-8da3-57d781a416f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:17.550871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311ebbc-69f6-462f-8da3-57d781a416f2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:17.573972 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 531/1064] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8311ebbc-69f6-462f-8da3-57d781a416f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:20:17.577305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:17.578301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:20:17.579234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:20:17.579234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:17.579234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:17.579838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 534/1065] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:17.586509 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee220d-51be-4943-8da4-b32e1cde2117 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:17.771089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee220d-51be-4943-8da4-b32e1cde2117 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:17.805846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:17.848131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1012753-df94-4577-ac34-52311f6ae28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:17.849104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1012753-df94-4577-ac34-52311f6ae28e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:17.849568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1012753-df94-4577-ac34-52311f6ae28e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:17.850029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1012753-df94-4577-ac34-52311f6ae28e None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:17.851196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1012753-df94-4577-ac34-52311f6ae28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:17.851699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1012753-df94-4577-ac34-52311f6ae28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:17.854180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1012753-df94-4577-ac34-52311f6ae28e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:17.882708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 532/1066] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:17.986567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311ebbc-69f6-462f-8da3-57d781a416f2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:18.012860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:18.184885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311ebbc-69f6-462f-8da3-57d781a416f2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:18.244901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee0663-d1e5-46ed-8a98-7b3368efb962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:18.246085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee0663-d1e5-46ed-8a98-7b3368efb962 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:18.246539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee0663-d1e5-46ed-8a98-7b3368efb962 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:18.246973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee0663-d1e5-46ed-8a98-7b3368efb962 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:18.262950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee0663-d1e5-46ed-8a98-7b3368efb962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-92ee0663-d1e5-46ed-8a98-7b3368efb962 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:20:18.268426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:18.270246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:18.271752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 535/1067] 10.222.0.78 () {56 vars in 1120 bytes} [Wed Aug 24 03:20:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:18.279302 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1012753-df94-4577-ac34-52311f6ae28e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:18.421273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1012753-df94-4577-ac34-52311f6ae28e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:18.474908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08795ece-560e-4dcf-83ce-a8767a3a26d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:18.475836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08795ece-560e-4dcf-83ce-a8767a3a26d9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:18.476298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08795ece-560e-4dcf-83ce-a8767a3a26d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:18.476754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08795ece-560e-4dcf-83ce-a8767a3a26d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:18.477938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08795ece-560e-4dcf-83ce-a8767a3a26d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:18.478461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08795ece-560e-4dcf-83ce-a8767a3a26d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:18.480958 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08795ece-560e-4dcf-83ce-a8767a3a26d9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:18.492455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 533/1068] 10.222.0.78 () {56 vars in 1115 bytes} [Wed Aug 24 03:20:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:18.500027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee0663-d1e5-46ed-8a98-7b3368efb962 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:18.584035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:18.644004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee0663-d1e5-46ed-8a98-7b3368efb962 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:18.684068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126a18f-298a-42e2-b359-56d3596e6d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:18.685162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126a18f-298a-42e2-b359-56d3596e6d49 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:18.685639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126a18f-298a-42e2-b359-56d3596e6d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:18.686102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126a18f-298a-42e2-b359-56d3596e6d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:18.702695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126a18f-298a-42e2-b359-56d3596e6d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:18.704177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126a18f-298a-42e2-b359-56d3596e6d49 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b126a18f-298a-42e2-b359-56d3596e6d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:20:18.725754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:18.728128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:20:18.730281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:20:18.730281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:18.730281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:18.730281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 536/1069] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:18.734318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08795ece-560e-4dcf-83ce-a8767a3a26d9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:18.802270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:18.906945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08795ece-560e-4dcf-83ce-a8767a3a26d9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:18.957239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd19391-55ec-4f1a-a4d5-dcda2eb54337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:18.957856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd19391-55ec-4f1a-a4d5-dcda2eb54337 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:18.958129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd19391-55ec-4f1a-a4d5-dcda2eb54337 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:18.958400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd19391-55ec-4f1a-a4d5-dcda2eb54337 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:18.959101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd19391-55ec-4f1a-a4d5-dcda2eb54337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:18.959399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd19391-55ec-4f1a-a4d5-dcda2eb54337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:18.960776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd19391-55ec-4f1a-a4d5-dcda2eb54337 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:18.981437 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 534/1070] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:18.983198 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126a18f-298a-42e2-b359-56d3596e6d49 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:19.124215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126a18f-298a-42e2-b359-56d3596e6d49 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:19.151180 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:19.165180 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570136e-6a84-40de-b371-04d3f5d44ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:19.165841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570136e-6a84-40de-b371-04d3f5d44ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:19.166110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570136e-6a84-40de-b371-04d3f5d44ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:19.166381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570136e-6a84-40de-b371-04d3f5d44ea1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:19.177267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570136e-6a84-40de-b371-04d3f5d44ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:19.178765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570136e-6a84-40de-b371-04d3f5d44ea1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a570136e-6a84-40de-b371-04d3f5d44ea1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:20:19.191876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:19.194083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:19.196042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 537/1071] 10.222.0.78 () {56 vars in 1093 bytes} [Wed Aug 24 03:20:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:19.200288 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd19391-55ec-4f1a-a4d5-dcda2eb54337 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:19.378298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:19.387540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd19391-55ec-4f1a-a4d5-dcda2eb54337 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:19.429681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8df3d-1fe9-4738-acca-422a598b730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:19.430770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8df3d-1fe9-4738-acca-422a598b730b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:19.431075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8df3d-1fe9-4738-acca-422a598b730b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:19.431439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8df3d-1fe9-4738-acca-422a598b730b None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:19.432325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8df3d-1fe9-4738-acca-422a598b730b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:19.432723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8df3d-1fe9-4738-acca-422a598b730b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:19.434296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8df3d-1fe9-4738-acca-422a598b730b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:19.456892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 535/1072] 10.222.0.78 () {56 vars in 1133 bytes} [Wed Aug 24 03:20:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:19.463040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570136e-6a84-40de-b371-04d3f5d44ea1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:19.587271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570136e-6a84-40de-b371-04d3f5d44ea1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:19.630752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8d67-81cd-496f-86b0-6ea872c6c111 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:19.631059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8d67-81cd-496f-86b0-6ea872c6c111 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:19.631385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8d67-81cd-496f-86b0-6ea872c6c111 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:19.633946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 536/1073] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:20:19.640604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72d77f-f45e-4c85-b9fa-64dfb85de065 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:19.641010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72d77f-f45e-4c85-b9fa-64dfb85de065 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:19.641370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72d77f-f45e-4c85-b9fa-64dfb85de065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:19.650696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc0952-b61a-4ce8-9504-bc927b20c5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:19.651744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc0952-b61a-4ce8-9504-bc927b20c5fa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:19.652209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc0952-b61a-4ce8-9504-bc927b20c5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:19.652667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc0952-b61a-4ce8-9504-bc927b20c5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:19.666261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ff72d77f-f45e-4c85-b9fa-64dfb85de065 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:19.667543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ff72d77f-f45e-4c85-b9fa-64dfb85de065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:19.677683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc0952-b61a-4ce8-9504-bc927b20c5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:19.679229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc0952-b61a-4ce8-9504-bc927b20c5fa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f6cc0952-b61a-4ce8-9504-bc927b20c5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:20:19.695177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:19.696271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:20:19.697618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:20:19.697618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:19.697618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:19.697618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 538/1074] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:19.702725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc0952-b61a-4ce8-9504-bc927b20c5fa None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:19.741184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:19.764365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 537/1075] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:19.816139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc0952-b61a-4ce8-9504-bc927b20c5fa None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:19.853796 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbc862-5bbd-425b-8b67-292bee129561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:19.854417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbc862-5bbd-425b-8b67-292bee129561 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:19.854715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbc862-5bbd-425b-8b67-292bee129561 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:19.854988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbc862-5bbd-425b-8b67-292bee129561 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:19.855650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbc862-5bbd-425b-8b67-292bee129561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:19.855949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbc862-5bbd-425b-8b67-292bee129561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:19.857339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbc862-5bbd-425b-8b67-292bee129561 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:19.870598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 539/1076] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:19.877017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72d77f-f45e-4c85-b9fa-64dfb85de065 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:20.017540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:20.033409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbc862-5bbd-425b-8b67-292bee129561 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:20.044989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72d77f-f45e-4c85-b9fa-64dfb85de065 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:20.087923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccbb05-4875-49a5-8433-fa11a3ecd278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:20.088565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccbb05-4875-49a5-8433-fa11a3ecd278 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:20.088832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccbb05-4875-49a5-8433-fa11a3ecd278 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:20.089103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccbb05-4875-49a5-8433-fa11a3ecd278 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:20.097807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccbb05-4875-49a5-8433-fa11a3ecd278 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:20.099306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccbb05-4875-49a5-8433-fa11a3ecd278 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-5cccbb05-4875-49a5-8433-fa11a3ecd278 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:20:20.111750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:20.113552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:20.115296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:20:20.115296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:20:20.115296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:20:20.115296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:20:20.115296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:20:20.115296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:20:20.115296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:20:20.115296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:20.115296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 538/1077] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:20.118840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccbb05-4875-49a5-8433-fa11a3ecd278 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:20.146201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:20.155167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbc862-5bbd-425b-8b67-292bee129561 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:20.197712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe630aa-5cba-46ae-8e6b-d5b04d789891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:20.198477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe630aa-5cba-46ae-8e6b-d5b04d789891 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:20.198870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe630aa-5cba-46ae-8e6b-d5b04d789891 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:20.199274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe630aa-5cba-46ae-8e6b-d5b04d789891 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:20.211484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe630aa-5cba-46ae-8e6b-d5b04d789891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-bfe630aa-5cba-46ae-8e6b-d5b04d789891 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:20:20.216280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:20.218144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:20.219371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 540/1078] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:20:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:20.223976 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe630aa-5cba-46ae-8e6b-d5b04d789891 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:20.232142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccbb05-4875-49a5-8433-fa11a3ecd278 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:20.273319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317e4d8-7b26-4dba-87ae-afb3c2c584e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:20.273938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317e4d8-7b26-4dba-87ae-afb3c2c584e9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:20.274411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317e4d8-7b26-4dba-87ae-afb3c2c584e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:20.274836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317e4d8-7b26-4dba-87ae-afb3c2c584e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:20.275515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317e4d8-7b26-4dba-87ae-afb3c2c584e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:20.275845 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317e4d8-7b26-4dba-87ae-afb3c2c584e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:20.277290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317e4d8-7b26-4dba-87ae-afb3c2c584e9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:20.290746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 539/1079] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:20.299904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317e4d8-7b26-4dba-87ae-afb3c2c584e9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:20.303905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:20.344256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe630aa-5cba-46ae-8e6b-d5b04d789891 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:20.383519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80271-0864-4f75-874b-f0d01db16e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:20.384134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80271-0864-4f75-874b-f0d01db16e1a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:20.384421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80271-0864-4f75-874b-f0d01db16e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:20.384691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80271-0864-4f75-874b-f0d01db16e1a None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:20.385336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80271-0864-4f75-874b-f0d01db16e1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:20.385644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80271-0864-4f75-874b-f0d01db16e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:20.387043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80271-0864-4f75-874b-f0d01db16e1a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:20.398227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 541/1080] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:20:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:20.404233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80271-0864-4f75-874b-f0d01db16e1a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:20.425726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:20.426856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317e4d8-7b26-4dba-87ae-afb3c2c584e9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:20.466524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294c79c-5c03-4041-83d8-afff62e77dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:20.469155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294c79c-5c03-4041-83d8-afff62e77dbc None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:20.469155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294c79c-5c03-4041-83d8-afff62e77dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:20.469155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294c79c-5c03-4041-83d8-afff62e77dbc None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/438786dead414066a6ef101a2493fb8c/roles/8d116fbf411c4e1f88d93f56486ef2fb` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:20.471369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294c79c-5c03-4041-83d8-afff62e77dbc None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=438786dead414066a6ef101a2493fb8c, role_id=8d116fbf411c4e1f88d93f56486ef2fb)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:20.473275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294c79c-5c03-4041-83d8-afff62e77dbc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:20.489270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 540/1081] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:20:20 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/438786dead414066a6ef101a2493fb8c/roles/8d116fbf411c4e1f88d93f56486ef2fb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:20:20.526412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80271-0864-4f75-874b-f0d01db16e1a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:20.568765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310331cf-1b28-4297-a600-00ddc28797c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:20.569511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310331cf-1b28-4297-a600-00ddc28797c6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:20.569825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310331cf-1b28-4297-a600-00ddc28797c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:20.570127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310331cf-1b28-4297-a600-00ddc28797c6 None admin] PATH_INFO: `/v3/users/1c73c580e4434ce99cf2b366c1f44e92` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:20.571518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310331cf-1b28-4297-a600-00ddc28797c6 None admin] RBAC: Authorizing `identity:get_user(user_id=1c73c580e4434ce99cf2b366c1f44e92)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:20.573434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310331cf-1b28-4297-a600-00ddc28797c6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:20.575328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 542/1082] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:20 2022] GET /identity/v3/users/1c73c580e4434ce99cf2b366c1f44e92 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:20.582214 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294c79c-5c03-4041-83d8-afff62e77dbc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:20.673433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:20.732924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294c79c-5c03-4041-83d8-afff62e77dbc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:20.790714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a27c-233f-4092-93c4-3d710c8a49e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:20.791716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a27c-233f-4092-93c4-3d710c8a49e5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:20.792229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a27c-233f-4092-93c4-3d710c8a49e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:20.792732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a27c-233f-4092-93c4-3d710c8a49e5 None admin] PATH_INFO: `/v3/projects/5a70d39744774b4f8bab2e59c3620aef` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:20.794810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5a27c-233f-4092-93c4-3d710c8a49e5 None admin] RBAC: Authorizing `identity:get_project(project_id=5a70d39744774b4f8bab2e59c3620aef)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:20.797582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5a27c-233f-4092-93c4-3d710c8a49e5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:20.800664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 541/1083] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:20:20 2022] GET /identity/v3/projects/5a70d39744774b4f8bab2e59c3620aef => generated 311 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:20.809807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310331cf-1b28-4297-a600-00ddc28797c6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:20.910595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:20.931203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310331cf-1b28-4297-a600-00ddc28797c6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:20.966916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618f4bd-9d7c-4eb4-bed6-b52fecdc6190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:20.967579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618f4bd-9d7c-4eb4-bed6-b52fecdc6190 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:20.967855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618f4bd-9d7c-4eb4-bed6-b52fecdc6190 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:20.968121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618f4bd-9d7c-4eb4-bed6-b52fecdc6190 None admin] PATH_INFO: `/v3/projects/5a70d39744774b4f8bab2e59c3620aef/users/1c73c580e4434ce99cf2b366c1f44e92/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:20.970106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618f4bd-9d7c-4eb4-bed6-b52fecdc6190 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a70d39744774b4f8bab2e59c3620aef, user_id=1c73c580e4434ce99cf2b366c1f44e92, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:20.971705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618f4bd-9d7c-4eb4-bed6-b52fecdc6190 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:20.988302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 543/1084] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:20:20 2022] PUT /identity/v3/projects/5a70d39744774b4f8bab2e59c3620aef/users/1c73c580e4434ce99cf2b366c1f44e92/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:20:22.510667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c09c-f6bd-4178-931c-cd70e1dd89ff None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:22.511273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c09c-f6bd-4178-931c-cd70e1dd89ff None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:22.511273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c09c-f6bd-4178-931c-cd70e1dd89ff None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:22.512588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 542/1085] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:22.518939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8ae7-4cb2-431e-b1d1-12fcded382e8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:22.519732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8ae7-4cb2-431e-b1d1-12fcded382e8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:22.519732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8ae7-4cb2-431e-b1d1-12fcded382e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:22.539496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e2ea8ae7-4cb2-431e-b1d1-12fcded382e8 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:22.540875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e2ea8ae7-4cb2-431e-b1d1-12fcded382e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:22.632442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 544/1086] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:22.901370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c09c-f6bd-4178-931c-cd70e1dd89ff None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:23.037974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c09c-f6bd-4178-931c-cd70e1dd89ff None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:23.090672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:23.099899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac07c-0887-405c-818b-f70d73bdc661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:23.100977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac07c-0887-405c-818b-f70d73bdc661 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:23.101443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac07c-0887-405c-818b-f70d73bdc661 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:23.101900 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac07c-0887-405c-818b-f70d73bdc661 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:23.120853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac07c-0887-405c-818b-f70d73bdc661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-43cac07c-0887-405c-818b-f70d73bdc661 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:20:23.130082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:23.131156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:20:23.131991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:23.132852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 543/1087] 10.222.0.78 () {56 vars in 1120 bytes} [Wed Aug 24 03:20:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:23.140890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8ae7-4cb2-431e-b1d1-12fcded382e8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:23.232899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:23.279382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8ae7-4cb2-431e-b1d1-12fcded382e8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:23.334455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b2bd0-8f68-4be1-b59d-d2b37c3a1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:23.335130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b2bd0-8f68-4be1-b59d-d2b37c3a1745 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:23.335433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b2bd0-8f68-4be1-b59d-d2b37c3a1745 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:23.335722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b2bd0-8f68-4be1-b59d-d2b37c3a1745 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:23.336396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b2bd0-8f68-4be1-b59d-d2b37c3a1745 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:23.336700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b2bd0-8f68-4be1-b59d-d2b37c3a1745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:23.338089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b2bd0-8f68-4be1-b59d-d2b37c3a1745 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:23.347222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 545/1088] 10.222.0.78 () {56 vars in 1115 bytes} [Wed Aug 24 03:20:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:23.352872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac07c-0887-405c-818b-f70d73bdc661 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:23.355977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07f5c-3724-4347-8a48-bd07174d3b81 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:23.356266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07f5c-3724-4347-8a48-bd07174d3b81 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:23.356544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07f5c-3724-4347-8a48-bd07174d3b81 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:23.357899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 546/1089] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:20:23.363482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f84f94-c35a-4333-8532-a317b826e0db None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:23.363776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f84f94-c35a-4333-8532-a317b826e0db None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:23.364037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f84f94-c35a-4333-8532-a317b826e0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:23.382685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-43f84f94-c35a-4333-8532-a317b826e0db None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:23.383891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-43f84f94-c35a-4333-8532-a317b826e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:23.456953 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 547/1090] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:23.463794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac07c-0887-405c-818b-f70d73bdc661 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:23.499403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e95b7-02e9-45d8-a076-159dde950241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:23.499915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e95b7-02e9-45d8-a076-159dde950241 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:23.500191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e95b7-02e9-45d8-a076-159dde950241 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:23.500457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e95b7-02e9-45d8-a076-159dde950241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:23.513150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e95b7-02e9-45d8-a076-159dde950241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:23.514606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e95b7-02e9-45d8-a076-159dde950241 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ed5e95b7-02e9-45d8-a076-159dde950241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:20:23.529688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:23.530756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:20:23.531645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:20:23.531645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:23.531645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:23.531645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 544/1091] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:23.537121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f84f94-c35a-4333-8532-a317b826e0db None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:23.609562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:23.649437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f84f94-c35a-4333-8532-a317b826e0db None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:23.690082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412c027-61e6-40c9-bf07-0247e37fb3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:23.690753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412c027-61e6-40c9-bf07-0247e37fb3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:23.691002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412c027-61e6-40c9-bf07-0247e37fb3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:23.691291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412c027-61e6-40c9-bf07-0247e37fb3e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:23.691961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412c027-61e6-40c9-bf07-0247e37fb3e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:23.692263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412c027-61e6-40c9-bf07-0247e37fb3e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:23.693670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412c027-61e6-40c9-bf07-0247e37fb3e2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:23.707375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 548/1092] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:23.713569 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e95b7-02e9-45d8-a076-159dde950241 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:23.734407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412c027-61e6-40c9-bf07-0247e37fb3e2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:23.768699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:23.833523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e95b7-02e9-45d8-a076-159dde950241 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:23.854046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412c027-61e6-40c9-bf07-0247e37fb3e2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:23.874142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d0a48-a7a1-4863-957b-5a3833251e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:23.874829 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d0a48-a7a1-4863-957b-5a3833251e07 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:23.875108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d0a48-a7a1-4863-957b-5a3833251e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:23.875374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d0a48-a7a1-4863-957b-5a3833251e07 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:23.883299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:23.884717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d0a48-a7a1-4863-957b-5a3833251e07 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:23.886454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d0a48-a7a1-4863-957b-5a3833251e07 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:23.894338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2a263-5c0a-428e-ada2-a7d224c78a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:23.895040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2a263-5c0a-428e-ada2-a7d224c78a9c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:23.895321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2a263-5c0a-428e-ada2-a7d224c78a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:23.895593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2a263-5c0a-428e-ada2-a7d224c78a9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-530d0a48-a7a1-4863-957b-5a3833251e07 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:20:23.899006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:23.900036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:23.900983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 545/1093] 10.222.0.78 () {56 vars in 1093 bytes} [Wed Aug 24 03:20:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:23.906351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d0a48-a7a1-4863-957b-5a3833251e07 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:23.908855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2a263-5c0a-428e-ada2-a7d224c78a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0ad2a263-5c0a-428e-ada2-a7d224c78a9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:20:23.913626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:23.915144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:23.916906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 549/1094] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:20:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:23.921253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2a263-5c0a-428e-ada2-a7d224c78a9c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:24.024846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d0a48-a7a1-4863-957b-5a3833251e07 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:24.027417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:24.034842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2a263-5c0a-428e-ada2-a7d224c78a9c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:24.071345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4108c-3c38-4dcd-8388-039f1b2ee477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:24.071971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4108c-3c38-4dcd-8388-039f1b2ee477 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:24.072593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4108c-3c38-4dcd-8388-039f1b2ee477 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:24.072856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4108c-3c38-4dcd-8388-039f1b2ee477 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:24.073607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4108c-3c38-4dcd-8388-039f1b2ee477 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:24.073905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4108c-3c38-4dcd-8388-039f1b2ee477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:24.075391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4108c-3c38-4dcd-8388-039f1b2ee477 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:24.085617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb2b06-1f00-4a29-a781-c72ce8c6bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:24.086133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2b06-1f00-4a29-a781-c72ce8c6bb24 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:24.086409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2b06-1f00-4a29-a781-c72ce8c6bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:24.086680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2b06-1f00-4a29-a781-c72ce8c6bb24 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:24.087380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb2b06-1f00-4a29-a781-c72ce8c6bb24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:24.087679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb2b06-1f00-4a29-a781-c72ce8c6bb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:24.089070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb2b06-1f00-4a29-a781-c72ce8c6bb24 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:24.099114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 546/1095] 10.222.0.78 () {56 vars in 1133 bytes} [Wed Aug 24 03:20:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:24.100884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 550/1096] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:20:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:24.105064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4108c-3c38-4dcd-8388-039f1b2ee477 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:24.108602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb2b06-1f00-4a29-a781-c72ce8c6bb24 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:24.167092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:24.227986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb2b06-1f00-4a29-a781-c72ce8c6bb24 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:24.237950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4108c-3c38-4dcd-8388-039f1b2ee477 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:24.267104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eae79b-cdf2-41e3-97b5-0d03dbed7753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:24.268059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eae79b-cdf2-41e3-97b5-0d03dbed7753 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:24.268344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eae79b-cdf2-41e3-97b5-0d03dbed7753 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:24.268618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eae79b-cdf2-41e3-97b5-0d03dbed7753 None admin] PATH_INFO: `/v3/users/1c73c580e4434ce99cf2b366c1f44e92` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:24.269859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eae79b-cdf2-41e3-97b5-0d03dbed7753 None admin] RBAC: Authorizing `identity:get_user(user_id=1c73c580e4434ce99cf2b366c1f44e92)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:24.271351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eae79b-cdf2-41e3-97b5-0d03dbed7753 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:24.273174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 551/1097] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:24 2022] GET /identity/v3/users/1c73c580e4434ce99cf2b366c1f44e92 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:24.279594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eae79b-cdf2-41e3-97b5-0d03dbed7753 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:24.282353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3ac79-9d87-4c98-9520-05db4a00e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:24.283021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3ac79-9d87-4c98-9520-05db4a00e9ed None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:24.283305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3ac79-9d87-4c98-9520-05db4a00e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:24.283750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3ac79-9d87-4c98-9520-05db4a00e9ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:24.323973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:24.369392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3ac79-9d87-4c98-9520-05db4a00e9ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:24.370887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3ac79-9d87-4c98-9520-05db4a00e9ed None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:24.406982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eae79b-cdf2-41e3-97b5-0d03dbed7753 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:24.430195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:24.454015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd4e93-7f2e-44bb-874f-2e37372a0e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:24.454621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd4e93-7f2e-44bb-874f-2e37372a0e86 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:24.455057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd4e93-7f2e-44bb-874f-2e37372a0e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:24.455417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd4e93-7f2e-44bb-874f-2e37372a0e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:24.503373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 547/1098] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:20:24.509259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3ac79-9d87-4c98-9520-05db4a00e9ed None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:24.545888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd4e93-7f2e-44bb-874f-2e37372a0e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:24.547312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd4e93-7f2e-44bb-874f-2e37372a0e86 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:24.584400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:24.629464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3ac79-9d87-4c98-9520-05db4a00e9ed None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:24.661117 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 552/1099] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:24.667319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd4e93-7f2e-44bb-874f-2e37372a0e86 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:24.667575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7444f66-fd88-479c-b065-db4b98378ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:24.668035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7444f66-fd88-479c-b065-db4b98378ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:24.668334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7444f66-fd88-479c-b065-db4b98378ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:24.668603 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7444f66-fd88-479c-b065-db4b98378ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:24.680676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7444f66-fd88-479c-b065-db4b98378ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:24.682143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7444f66-fd88-479c-b065-db4b98378ef8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:24.686706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-c7444f66-fd88-479c-b065-db4b98378ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:20:24.699066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:24.700200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:20:24.701090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:20:24.701090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:20:24.701090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:24.701090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 548/1100] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:24.706193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7444f66-fd88-479c-b065-db4b98378ef8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:24.796834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd4e93-7f2e-44bb-874f-2e37372a0e86 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:24.851787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7444f66-fd88-479c-b065-db4b98378ef8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:24.852360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5356c-0dad-43fa-863a-dad8f4a10671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:24.853322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5356c-0dad-43fa-863a-dad8f4a10671 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:24.853757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5356c-0dad-43fa-863a-dad8f4a10671 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:24.854179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5356c-0dad-43fa-863a-dad8f4a10671 None admin] PATH_INFO: `/v3/projects/5a70d39744774b4f8bab2e59c3620aef` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:24.855898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5356c-0dad-43fa-863a-dad8f4a10671 None admin] RBAC: Authorizing `identity:get_project(project_id=5a70d39744774b4f8bab2e59c3620aef)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:24.858058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5356c-0dad-43fa-863a-dad8f4a10671 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:24.861953 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 553/1101] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:20:24 2022] GET /identity/v3/projects/5a70d39744774b4f8bab2e59c3620aef => generated 311 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:24.868847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5356c-0dad-43fa-863a-dad8f4a10671 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:24.871885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:24.905739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da180ec-b97f-436d-8293-7e0e0b3ea9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:24.906359 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da180ec-b97f-436d-8293-7e0e0b3ea9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:24.906630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da180ec-b97f-436d-8293-7e0e0b3ea9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:24.906942 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da180ec-b97f-436d-8293-7e0e0b3ea9e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:24.907607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da180ec-b97f-436d-8293-7e0e0b3ea9e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:24.908033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da180ec-b97f-436d-8293-7e0e0b3ea9e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:24.909891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da180ec-b97f-436d-8293-7e0e0b3ea9e8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:24.923066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 549/1102] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:24.929290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da180ec-b97f-436d-8293-7e0e0b3ea9e8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:24.975020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:24.988898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5356c-0dad-43fa-863a-dad8f4a10671 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:25.027309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4892ba8-26b3-4450-9809-e468b1e68e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:25.027929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4892ba8-26b3-4450-9809-e468b1e68e69 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:25.028205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4892ba8-26b3-4450-9809-e468b1e68e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:25.028470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4892ba8-26b3-4450-9809-e468b1e68e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:25.029201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4892ba8-26b3-4450-9809-e468b1e68e69 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=5a70d39744774b4f8bab2e59c3620aef, user.id=1c73c580e4434ce99cf2b366c1f44e92) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:25.029507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4892ba8-26b3-4450-9809-e468b1e68e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:25.030978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4892ba8-26b3-4450-9809-e468b1e68e69 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:25.037506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 554/1103] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:20:24 2022] GET /identity/v3/role_assignments?user.id=1c73c580e4434ce99cf2b366c1f44e92&scope.project.id=5a70d39744774b4f8bab2e59c3620aef&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:25.052530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da180ec-b97f-436d-8293-7e0e0b3ea9e8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:25.096325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394991-4f6b-4288-9abe-be308d85f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:25.097141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394991-4f6b-4288-9abe-be308d85f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:25.097422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394991-4f6b-4288-9abe-be308d85f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:25.097693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394991-4f6b-4288-9abe-be308d85f4b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:25.110547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26394991-4f6b-4288-9abe-be308d85f4b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:25.112292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26394991-4f6b-4288-9abe-be308d85f4b9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-26394991-4f6b-4288-9abe-be308d85f4b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:20:25.125165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:25.126879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:25.129503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:20:25.129503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:20:25.129503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:20:25.129503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:20:25.129503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:20:25.129503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:20:25.129503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:20:25.129503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:25.130873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 550/1104] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:20:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:20:25.132743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4892ba8-26b3-4450-9809-e468b1e68e69 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:25.260500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4892ba8-26b3-4450-9809-e468b1e68e69 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:25.296997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe3db7-468f-4c67-8269-4857924b63f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:25.297610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe3db7-468f-4c67-8269-4857924b63f7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:25.297887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe3db7-468f-4c67-8269-4857924b63f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:25.298159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe3db7-468f-4c67-8269-4857924b63f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:25.299377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe3db7-468f-4c67-8269-4857924b63f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:25.299683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe3db7-468f-4c67-8269-4857924b63f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:25.301120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe3db7-468f-4c67-8269-4857924b63f7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:25.323565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 555/1105] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:25.330442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394991-4f6b-4288-9abe-be308d85f4b9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:25.377868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:25.451637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394991-4f6b-4288-9abe-be308d85f4b9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:25.489180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658159bc-50e8-402f-b736-9b2c0187e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:25.489791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658159bc-50e8-402f-b736-9b2c0187e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:25.490064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658159bc-50e8-402f-b736-9b2c0187e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:25.490310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658159bc-50e8-402f-b736-9b2c0187e7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:25.491103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658159bc-50e8-402f-b736-9b2c0187e7d5 None admin] RBAC: Adding query filter params (role.id=8d116fbf411c4e1f88d93f56486ef2fb, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=438786dead414066a6ef101a2493fb8c) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:25.491395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658159bc-50e8-402f-b736-9b2c0187e7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:25.492828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658159bc-50e8-402f-b736-9b2c0187e7d5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:25.499292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 551/1106] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:20:25 2022] GET /identity/v3/role_assignments?user.id=438786dead414066a6ef101a2493fb8c&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=8d116fbf411c4e1f88d93f56486ef2fb => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:27.012432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ac49-140f-425a-aec5-74ea651a59a2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:27.013255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ac49-140f-425a-aec5-74ea651a59a2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:27.013460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ac49-140f-425a-aec5-74ea651a59a2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:27.014881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 556/1107] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:20:27.021122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b77a-57af-457a-a86e-c7cbcc9e9ea6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:27.021606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b77a-57af-457a-a86e-c7cbcc9e9ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:27.021696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b77a-57af-457a-a86e-c7cbcc9e9ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:27.040602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2654b77a-57af-457a-a86e-c7cbcc9e9ea6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:27.041842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2654b77a-57af-457a-a86e-c7cbcc9e9ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:27.116969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 552/1108] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:27.379660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ac49-140f-425a-aec5-74ea651a59a2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:27.391458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:27.503456 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ac49-140f-425a-aec5-74ea651a59a2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:27.547512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f2ad8-48b4-48a0-912a-b9b2bd5ae8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:27.548170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f2ad8-48b4-48a0-912a-b9b2bd5ae8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:27.548471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f2ad8-48b4-48a0-912a-b9b2bd5ae8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:27.548933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f2ad8-48b4-48a0-912a-b9b2bd5ae8d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:27.550775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f2ad8-48b4-48a0-912a-b9b2bd5ae8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:27.552342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f2ad8-48b4-48a0-912a-b9b2bd5ae8d6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:27.554120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 557/1109] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:27.560549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b77a-57af-457a-a86e-c7cbcc9e9ea6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:27.594932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:27.676998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b77a-57af-457a-a86e-c7cbcc9e9ea6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:27.715878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8932a56-17e1-4d09-9213-502db7609d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:27.716490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8932a56-17e1-4d09-9213-502db7609d89 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:27.716766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8932a56-17e1-4d09-9213-502db7609d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:27.717031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8932a56-17e1-4d09-9213-502db7609d89 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:27.717674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8932a56-17e1-4d09-9213-502db7609d89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:27.719172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8932a56-17e1-4d09-9213-502db7609d89 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:27.742515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 553/1110] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:20:27 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:20:29.709861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bed42-396c-4a5b-814f-a73125c8807a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:29.710559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bed42-396c-4a5b-814f-a73125c8807a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:29.710559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bed42-396c-4a5b-814f-a73125c8807a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:29.711771 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 558/1111] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:29.717759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559a1fb-1c07-45af-8c2a-86d830448a42 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:29.718386 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559a1fb-1c07-45af-8c2a-86d830448a42 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:29.718386 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559a1fb-1c07-45af-8c2a-86d830448a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:29.739436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0559a1fb-1c07-45af-8c2a-86d830448a42 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:29.740662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0559a1fb-1c07-45af-8c2a-86d830448a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:29.817160 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 554/1112] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:30.087525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bed42-396c-4a5b-814f-a73125c8807a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:30.170972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:30.196620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bed42-396c-4a5b-814f-a73125c8807a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:30.234599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05448994-aacf-445c-843d-c97606d7ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:30.235269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05448994-aacf-445c-843d-c97606d7ef40 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:30.235548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05448994-aacf-445c-843d-c97606d7ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:30.235818 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05448994-aacf-445c-843d-c97606d7ef40 None admin] PATH_INFO: `/v3/roles/2e42b82a17a84744960aa3904ab682cc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:30.237353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05448994-aacf-445c-843d-c97606d7ef40 None admin] RBAC: Authorizing `identity:get_role(role_id=2e42b82a17a84744960aa3904ab682cc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:30.238777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05448994-aacf-445c-843d-c97606d7ef40 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:30.240150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 559/1113] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:30 2022] GET /identity/v3/roles/2e42b82a17a84744960aa3904ab682cc => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:30.246225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559a1fb-1c07-45af-8c2a-86d830448a42 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:30.265262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:30.359738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559a1fb-1c07-45af-8c2a-86d830448a42 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:30.398128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293efda-a400-4278-b287-84ad2dc184b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:30.398810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293efda-a400-4278-b287-84ad2dc184b1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:30.399086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293efda-a400-4278-b287-84ad2dc184b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:30.399352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293efda-a400-4278-b287-84ad2dc184b1 None admin] PATH_INFO: `/v3/users/30476af8a0484616a13b40a58c97b31a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:30.413935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293efda-a400-4278-b287-84ad2dc184b1 None admin] RBAC: Authorizing `identity:get_user(user_id=30476af8a0484616a13b40a58c97b31a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:30.415423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293efda-a400-4278-b287-84ad2dc184b1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:30.417136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 555/1114] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:30 2022] GET /identity/v3/users/30476af8a0484616a13b40a58c97b31a => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:30.424067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05448994-aacf-445c-843d-c97606d7ef40 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:30.530598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05448994-aacf-445c-843d-c97606d7ef40 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:30.565434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8f4d-3b79-409e-aaaa-8db8b1550082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:30.566033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8f4d-3b79-409e-aaaa-8db8b1550082 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:30.566314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8f4d-3b79-409e-aaaa-8db8b1550082 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:30.566579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8f4d-3b79-409e-aaaa-8db8b1550082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:30.586690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:30.661412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a8f4d-3b79-409e-aaaa-8db8b1550082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:30.663101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a8f4d-3b79-409e-aaaa-8db8b1550082 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:30.783996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 560/1115] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:30.790130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293efda-a400-4278-b287-84ad2dc184b1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:30.879342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:30.913640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293efda-a400-4278-b287-84ad2dc184b1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:30.951119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa780eb-5e6e-4a4d-b9d1-8781c7a42835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:30.951757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa780eb-5e6e-4a4d-b9d1-8781c7a42835 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:30.952033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa780eb-5e6e-4a4d-b9d1-8781c7a42835 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:30.952299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa780eb-5e6e-4a4d-b9d1-8781c7a42835 None admin] PATH_INFO: `/v3/projects/5a70d39744774b4f8bab2e59c3620aef` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:30.953456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa780eb-5e6e-4a4d-b9d1-8781c7a42835 None admin] RBAC: Authorizing `identity:get_project(project_id=5a70d39744774b4f8bab2e59c3620aef)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:30.955049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa780eb-5e6e-4a4d-b9d1-8781c7a42835 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:30.956803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 556/1116] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:20:30 2022] GET /identity/v3/projects/5a70d39744774b4f8bab2e59c3620aef => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:30.963286 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8f4d-3b79-409e-aaaa-8db8b1550082 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:31.015887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:31.080092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8f4d-3b79-409e-aaaa-8db8b1550082 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:31.115887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc757d-28a8-4520-a07f-4c52ae506833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:31.116509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc757d-28a8-4520-a07f-4c52ae506833 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:31.116788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc757d-28a8-4520-a07f-4c52ae506833 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:31.117059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc757d-28a8-4520-a07f-4c52ae506833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:31.117794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc757d-28a8-4520-a07f-4c52ae506833 None admin] RBAC: Adding query filter params (role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=5a70d39744774b4f8bab2e59c3620aef, user.id=30476af8a0484616a13b40a58c97b31a) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:31.118104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc757d-28a8-4520-a07f-4c52ae506833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:31.119589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc757d-28a8-4520-a07f-4c52ae506833 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:31.125533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 561/1117] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:20:30 2022] GET /identity/v3/role_assignments?user.id=30476af8a0484616a13b40a58c97b31a&scope.project.id=5a70d39744774b4f8bab2e59c3620aef&role.id=2e42b82a17a84744960aa3904ab682cc => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:33.042556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc26c8-4711-4485-94c4-f01ea948180e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:33.043164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc26c8-4711-4485-94c4-f01ea948180e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:33.043164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc26c8-4711-4485-94c4-f01ea948180e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:33.044483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 557/1118] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:33.050308 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee57cf-d44c-40b9-9cee-9d6efc182734 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:33.050871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee57cf-d44c-40b9-9cee-9d6efc182734 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:33.050871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee57cf-d44c-40b9-9cee-9d6efc182734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:33.072773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-19ee57cf-d44c-40b9-9cee-9d6efc182734 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:33.074839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-19ee57cf-d44c-40b9-9cee-9d6efc182734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:33.155912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 562/1119] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:33.431298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc26c8-4711-4485-94c4-f01ea948180e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:33.544486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc26c8-4711-4485-94c4-f01ea948180e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:33.587945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a648110-0f56-4ee2-bc61-0cd5e77994aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:33.588589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a648110-0f56-4ee2-bc61-0cd5e77994aa None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:33.588866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a648110-0f56-4ee2-bc61-0cd5e77994aa None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:33.589130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a648110-0f56-4ee2-bc61-0cd5e77994aa None admin] PATH_INFO: `/v3/roles/2e42b82a17a84744960aa3904ab682cc` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:33.590602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a648110-0f56-4ee2-bc61-0cd5e77994aa None admin] RBAC: Authorizing `identity:get_role(role_id=2e42b82a17a84744960aa3904ab682cc)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:33.592024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a648110-0f56-4ee2-bc61-0cd5e77994aa None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:33.593444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 558/1120] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:33 2022] GET /identity/v3/roles/2e42b82a17a84744960aa3904ab682cc => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:33.599994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee57cf-d44c-40b9-9cee-9d6efc182734 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:33.645981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:33.712868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee57cf-d44c-40b9-9cee-9d6efc182734 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:33.748638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38691bd5-7b7e-452f-91a1-f54782123e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:33.749279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691bd5-7b7e-452f-91a1-f54782123e8c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:33.749559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691bd5-7b7e-452f-91a1-f54782123e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:33.749830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691bd5-7b7e-452f-91a1-f54782123e8c None admin] PATH_INFO: `/v3/users/30476af8a0484616a13b40a58c97b31a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:33.751036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38691bd5-7b7e-452f-91a1-f54782123e8c None admin] RBAC: Authorizing `identity:get_user(user_id=30476af8a0484616a13b40a58c97b31a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:33.753048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38691bd5-7b7e-452f-91a1-f54782123e8c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:33.754769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 563/1121] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:33 2022] GET /identity/v3/users/30476af8a0484616a13b40a58c97b31a => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:33.764502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a648110-0f56-4ee2-bc61-0cd5e77994aa None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:33.784592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:33.893057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a648110-0f56-4ee2-bc61-0cd5e77994aa None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:33.934641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea6d73-3523-47e0-a947-7be7de6dde9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:33.935310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea6d73-3523-47e0-a947-7be7de6dde9e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:33.935583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea6d73-3523-47e0-a947-7be7de6dde9e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:33.935854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea6d73-3523-47e0-a947-7be7de6dde9e None admin] PATH_INFO: `/v3/projects/5a70d39744774b4f8bab2e59c3620aef` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:33.937030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea6d73-3523-47e0-a947-7be7de6dde9e None admin] RBAC: Authorizing `identity:get_project(project_id=5a70d39744774b4f8bab2e59c3620aef)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:33.938469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea6d73-3523-47e0-a947-7be7de6dde9e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:33.940205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 559/1122] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:20:33 2022] GET /identity/v3/projects/5a70d39744774b4f8bab2e59c3620aef => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:33.946588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38691bd5-7b7e-452f-91a1-f54782123e8c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:34.069893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38691bd5-7b7e-452f-91a1-f54782123e8c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:34.079579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:34.114816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3336270-84e0-4f85-a366-b53127c903f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:34.115506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3336270-84e0-4f85-a366-b53127c903f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:34.115777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3336270-84e0-4f85-a366-b53127c903f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:34.116050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3336270-84e0-4f85-a366-b53127c903f0 None admin] PATH_INFO: `/v3/projects/5a70d39744774b4f8bab2e59c3620aef/users/30476af8a0484616a13b40a58c97b31a/roles/2e42b82a17a84744960aa3904ab682cc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:34.118295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3336270-84e0-4f85-a366-b53127c903f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a70d39744774b4f8bab2e59c3620aef, user_id=30476af8a0484616a13b40a58c97b31a, role_id=2e42b82a17a84744960aa3904ab682cc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:34.119787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3336270-84e0-4f85-a366-b53127c903f0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:34.139950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 564/1123] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:20:33 2022] PUT /identity/v3/projects/5a70d39744774b4f8bab2e59c3620aef/users/30476af8a0484616a13b40a58c97b31a/roles/2e42b82a17a84744960aa3904ab682cc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:20:36.115610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3739d-af3b-45c7-a54c-fc79e33b18ab None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:36.116194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3739d-af3b-45c7-a54c-fc79e33b18ab None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:36.116544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3739d-af3b-45c7-a54c-fc79e33b18ab None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:36.119124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 560/1124] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:36.127611 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07314a4e-c42a-494c-b61a-691c91672299 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:36.128167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07314a4e-c42a-494c-b61a-691c91672299 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:36.128167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07314a4e-c42a-494c-b61a-691c91672299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:36.147816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-07314a4e-c42a-494c-b61a-691c91672299 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:36.149119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-07314a4e-c42a-494c-b61a-691c91672299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:36.222716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 565/1125] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:36.492909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3739d-af3b-45c7-a54c-fc79e33b18ab None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:36.586079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:36.615173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3739d-af3b-45c7-a54c-fc79e33b18ab None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:36.653688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e049f2-dfc0-48db-8dee-a7deec8603d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:36.654325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e049f2-dfc0-48db-8dee-a7deec8603d2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:36.654598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e049f2-dfc0-48db-8dee-a7deec8603d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:36.654893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e049f2-dfc0-48db-8dee-a7deec8603d2 None admin] PATH_INFO: `/v3/roles/2e42b82a17a84744960aa3904ab682cc` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:36.656343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e049f2-dfc0-48db-8dee-a7deec8603d2 None admin] RBAC: Authorizing `identity:get_role(role_id=2e42b82a17a84744960aa3904ab682cc)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:36.657825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e049f2-dfc0-48db-8dee-a7deec8603d2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:36.659687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 561/1126] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:36 2022] GET /identity/v3/roles/2e42b82a17a84744960aa3904ab682cc => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:36.668841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07314a4e-c42a-494c-b61a-691c91672299 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:36.806181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:36.817507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07314a4e-c42a-494c-b61a-691c91672299 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:36.858082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e10401-293d-4247-bd96-e64e1f5936b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:36.858744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e10401-293d-4247-bd96-e64e1f5936b7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:36.859042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e10401-293d-4247-bd96-e64e1f5936b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:36.859316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e10401-293d-4247-bd96-e64e1f5936b7 None admin] PATH_INFO: `/v3/users/30476af8a0484616a13b40a58c97b31a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:36.860541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e10401-293d-4247-bd96-e64e1f5936b7 None admin] RBAC: Authorizing `identity:get_user(user_id=30476af8a0484616a13b40a58c97b31a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:36.862173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e10401-293d-4247-bd96-e64e1f5936b7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:36.863858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 566/1127] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:36 2022] GET /identity/v3/users/30476af8a0484616a13b40a58c97b31a => generated 286 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:36.870473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e049f2-dfc0-48db-8dee-a7deec8603d2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:36.983263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e049f2-dfc0-48db-8dee-a7deec8603d2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:37.022116 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c23b6-9e48-4047-b68f-9793377af222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:37.022834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c23b6-9e48-4047-b68f-9793377af222 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:37.023158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c23b6-9e48-4047-b68f-9793377af222 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:37.023479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c23b6-9e48-4047-b68f-9793377af222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:37.041405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:37.107602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c23b6-9e48-4047-b68f-9793377af222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:37.109080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c23b6-9e48-4047-b68f-9793377af222 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:37.224156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 562/1128] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:20:37.230757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e10401-293d-4247-bd96-e64e1f5936b7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:37.356564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e10401-293d-4247-bd96-e64e1f5936b7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:37.406382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87869f39-bf89-4a94-9cd3-dbe0cccb9153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:37.406981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87869f39-bf89-4a94-9cd3-dbe0cccb9153 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:37.407257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87869f39-bf89-4a94-9cd3-dbe0cccb9153 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:37.407551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87869f39-bf89-4a94-9cd3-dbe0cccb9153 None admin] PATH_INFO: `/v3/projects/5a70d39744774b4f8bab2e59c3620aef` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:37.409656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87869f39-bf89-4a94-9cd3-dbe0cccb9153 None admin] RBAC: Authorizing `identity:get_project(project_id=5a70d39744774b4f8bab2e59c3620aef)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:37.411327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87869f39-bf89-4a94-9cd3-dbe0cccb9153 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:37.413267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 567/1129] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:20:37 2022] GET /identity/v3/projects/5a70d39744774b4f8bab2e59c3620aef => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:37.419950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c23b6-9e48-4047-b68f-9793377af222 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:37.475056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:37.539751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c23b6-9e48-4047-b68f-9793377af222 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:37.579020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938a5dc-35bf-4cbf-9c8a-b39bba1f672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:37.579693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938a5dc-35bf-4cbf-9c8a-b39bba1f672e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:37.580123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938a5dc-35bf-4cbf-9c8a-b39bba1f672e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:37.580596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938a5dc-35bf-4cbf-9c8a-b39bba1f672e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:37.581371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938a5dc-35bf-4cbf-9c8a-b39bba1f672e None admin] RBAC: Adding query filter params (role.id=2e42b82a17a84744960aa3904ab682cc, scope.project.id=5a70d39744774b4f8bab2e59c3620aef, user.id=30476af8a0484616a13b40a58c97b31a) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:37.581670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938a5dc-35bf-4cbf-9c8a-b39bba1f672e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:37.583152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938a5dc-35bf-4cbf-9c8a-b39bba1f672e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:37.590000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 563/1130] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:20:37 2022] GET /identity/v3/role_assignments?user.id=30476af8a0484616a13b40a58c97b31a&scope.project.id=5a70d39744774b4f8bab2e59c3620aef&role.id=2e42b82a17a84744960aa3904ab682cc => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:39.603696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86583a02-23ba-4581-b5ed-0469908bf79e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:39.604533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86583a02-23ba-4581-b5ed-0469908bf79e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:39.604533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86583a02-23ba-4581-b5ed-0469908bf79e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:39.606223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 568/1131] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:39.612864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60792321-45f2-4d03-a553-ebdda7abdcd7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:39.613361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60792321-45f2-4d03-a553-ebdda7abdcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:39.613361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60792321-45f2-4d03-a553-ebdda7abdcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:39.632363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-60792321-45f2-4d03-a553-ebdda7abdcd7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:39.633572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-60792321-45f2-4d03-a553-ebdda7abdcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:39.709170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 564/1132] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:20:39.988750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86583a02-23ba-4581-b5ed-0469908bf79e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:40.027809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:40.110323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86583a02-23ba-4581-b5ed-0469908bf79e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:40.146999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8e5a6-c157-4118-8de8-fa758d97ec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:40.147697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8e5a6-c157-4118-8de8-fa758d97ec99 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:40.148017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8e5a6-c157-4118-8de8-fa758d97ec99 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:40.148346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8e5a6-c157-4118-8de8-fa758d97ec99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:40.149553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8e5a6-c157-4118-8de8-fa758d97ec99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:40.151147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8e5a6-c157-4118-8de8-fa758d97ec99 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:40.152883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 569/1133] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:40.159731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60792321-45f2-4d03-a553-ebdda7abdcd7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:40.207889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:40.276386 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60792321-45f2-4d03-a553-ebdda7abdcd7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:40.313810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef6db-6ee1-41ed-b8fd-0ce574594ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:40.314427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef6db-6ee1-41ed-b8fd-0ce574594ffe None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:40.314710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef6db-6ee1-41ed-b8fd-0ce574594ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:40.314980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef6db-6ee1-41ed-b8fd-0ce574594ffe None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:40.315655 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ef6db-6ee1-41ed-b8fd-0ce574594ffe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:40.317139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ef6db-6ee1-41ed-b8fd-0ce574594ffe None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:40.349584 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 565/1134] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:20:40 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:20:42.337790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed724f-50ea-43c6-b425-d2f7f87be033 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:42.338407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed724f-50ea-43c6-b425-d2f7f87be033 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:42.338407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed724f-50ea-43c6-b425-d2f7f87be033 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:42.339738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 570/1135] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:42.347048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f96b-84fb-4e45-a6f8-ae5df2aee9b5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:42.347555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f96b-84fb-4e45-a6f8-ae5df2aee9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:42.347951 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f96b-84fb-4e45-a6f8-ae5df2aee9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:42.370168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c6f3f96b-84fb-4e45-a6f8-ae5df2aee9b5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:42.371433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c6f3f96b-84fb-4e45-a6f8-ae5df2aee9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:42.449038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 566/1136] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:42.718489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed724f-50ea-43c6-b425-d2f7f87be033 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:42.826711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:42.831528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed724f-50ea-43c6-b425-d2f7f87be033 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:42.873448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeca2a-318e-42dd-9a27-66abeb8669d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:42.874008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeca2a-318e-42dd-9a27-66abeb8669d8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:42.874281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeca2a-318e-42dd-9a27-66abeb8669d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:42.874550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeca2a-318e-42dd-9a27-66abeb8669d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:42.875839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeca2a-318e-42dd-9a27-66abeb8669d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:42.878100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeca2a-318e-42dd-9a27-66abeb8669d8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:42.879851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 571/1137] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:20:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:42.886117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3f96b-84fb-4e45-a6f8-ae5df2aee9b5 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:42.911527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:43.000703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3f96b-84fb-4e45-a6f8-ae5df2aee9b5 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:43.038826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead3af0-fd81-4359-a2c1-b7ced04a3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:43.039453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead3af0-fd81-4359-a2c1-b7ced04a3d85 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:43.039726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead3af0-fd81-4359-a2c1-b7ced04a3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:43.040017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead3af0-fd81-4359-a2c1-b7ced04a3d85 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:43.040678 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead3af0-fd81-4359-a2c1-b7ced04a3d85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:43.042119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead3af0-fd81-4359-a2c1-b7ced04a3d85 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:43.068098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 567/1138] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:20:42 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:20:45.056600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826facc-27bd-4c1e-a2d7-6f09abcfee0b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:45.057207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826facc-27bd-4c1e-a2d7-6f09abcfee0b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:45.057207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826facc-27bd-4c1e-a2d7-6f09abcfee0b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:45.058532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 572/1139] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:45.064366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950c425-420d-485c-9f87-704e324ec333 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:45.064915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950c425-420d-485c-9f87-704e324ec333 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:45.065151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950c425-420d-485c-9f87-704e324ec333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:45.084525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8950c425-420d-485c-9f87-704e324ec333 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:45.085734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8950c425-420d-485c-9f87-704e324ec333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:45.162490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 568/1140] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:45.430804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826facc-27bd-4c1e-a2d7-6f09abcfee0b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:45.561133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826facc-27bd-4c1e-a2d7-6f09abcfee0b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:45.602370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466989b3-95fe-4dd1-92c1-0ca77d1a4639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:45.603035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466989b3-95fe-4dd1-92c1-0ca77d1a4639 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:45.603311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466989b3-95fe-4dd1-92c1-0ca77d1a4639 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:45.603579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466989b3-95fe-4dd1-92c1-0ca77d1a4639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:45.621460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466989b3-95fe-4dd1-92c1-0ca77d1a4639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-466989b3-95fe-4dd1-92c1-0ca77d1a4639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:20:45.631667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:45.632966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:45.634062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 573/1141] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:20:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:45.640539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950c425-420d-485c-9f87-704e324ec333 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:45.650191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:45.755165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950c425-420d-485c-9f87-704e324ec333 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:45.794392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606b4b2-727e-4f21-88ae-68893c9983e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:45.795136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606b4b2-727e-4f21-88ae-68893c9983e1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:45.795454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606b4b2-727e-4f21-88ae-68893c9983e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:45.795765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606b4b2-727e-4f21-88ae-68893c9983e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:45.796491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606b4b2-727e-4f21-88ae-68893c9983e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:45.796836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606b4b2-727e-4f21-88ae-68893c9983e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:45.798472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606b4b2-727e-4f21-88ae-68893c9983e1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:45.808429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 569/1142] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:20:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:45.815271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466989b3-95fe-4dd1-92c1-0ca77d1a4639 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:45.848946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:45.963841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466989b3-95fe-4dd1-92c1-0ca77d1a4639 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:46.016670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dd480-4269-4f5c-8006-94fc439bd1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:46.017257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd480-4269-4f5c-8006-94fc439bd1ab None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:46.017529 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd480-4269-4f5c-8006-94fc439bd1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:46.017794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd480-4269-4f5c-8006-94fc439bd1ab None admin] PATH_INFO: `/v3/users/4fd9d5a75266435db901a110ed911df4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:46.033642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dd480-4269-4f5c-8006-94fc439bd1ab None admin] RBAC: Authorizing `identity:get_user(user_id=4fd9d5a75266435db901a110ed911df4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:46.035162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dd480-4269-4f5c-8006-94fc439bd1ab None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:46.036882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 574/1143] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:45 2022] GET /identity/v3/users/4fd9d5a75266435db901a110ed911df4 => generated 286 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:46.043527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606b4b2-727e-4f21-88ae-68893c9983e1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:46.121073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:46.161969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606b4b2-727e-4f21-88ae-68893c9983e1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:46.203650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefdffa-3e08-4210-9544-f826d44a9f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:46.204397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefdffa-3e08-4210-9544-f826d44a9f78 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:46.205349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefdffa-3e08-4210-9544-f826d44a9f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:46.205627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefdffa-3e08-4210-9544-f826d44a9f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:46.286263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefdffa-3e08-4210-9544-f826d44a9f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:46.287688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefdffa-3e08-4210-9544-f826d44a9f78 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:46.369638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:46.415314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 570/1144] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:46.425552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dd480-4269-4f5c-8006-94fc439bd1ab None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:46.524291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:46.542391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dd480-4269-4f5c-8006-94fc439bd1ab None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:46.585217 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8086ea-f282-4e83-9ff3-d038b7954a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:46.585938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8086ea-f282-4e83-9ff3-d038b7954a56 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:46.586258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8086ea-f282-4e83-9ff3-d038b7954a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:46.586572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8086ea-f282-4e83-9ff3-d038b7954a56 None admin] PATH_INFO: `/v3/projects/dccbb382b0494b98b3de3a63f4953218` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:46.588269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8086ea-f282-4e83-9ff3-d038b7954a56 None admin] RBAC: Authorizing `identity:get_project(project_id=dccbb382b0494b98b3de3a63f4953218)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:46.590625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8086ea-f282-4e83-9ff3-d038b7954a56 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:46.592728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 575/1145] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:20:46 2022] GET /identity/v3/projects/dccbb382b0494b98b3de3a63f4953218 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:46.599872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefdffa-3e08-4210-9544-f826d44a9f78 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:46.731098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefdffa-3e08-4210-9544-f826d44a9f78 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:46.771410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4ef76-ac7a-433f-bf58-6021f9247488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:46.772018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4ef76-ac7a-433f-bf58-6021f9247488 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:46.772290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4ef76-ac7a-433f-bf58-6021f9247488 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:46.772558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4ef76-ac7a-433f-bf58-6021f9247488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:46.773295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4ef76-ac7a-433f-bf58-6021f9247488 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=dccbb382b0494b98b3de3a63f4953218, user.id=4fd9d5a75266435db901a110ed911df4) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:46.773596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4ef76-ac7a-433f-bf58-6021f9247488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:46.775060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4ef76-ac7a-433f-bf58-6021f9247488 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:46.781246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 571/1146] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:20:46 2022] GET /identity/v3/role_assignments?user.id=4fd9d5a75266435db901a110ed911df4&scope.project.id=dccbb382b0494b98b3de3a63f4953218&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:48.744590 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4ea70-bdec-4f4d-aa6d-74e3f711f8c5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:48.745177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4ea70-bdec-4f4d-aa6d-74e3f711f8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:48.745177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4ea70-bdec-4f4d-aa6d-74e3f711f8c5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:48.746484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 576/1147] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:48.752243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b478bd-f911-44f5-a00a-754712db1bfc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:48.752728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b478bd-f911-44f5-a00a-754712db1bfc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:48.752820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b478bd-f911-44f5-a00a-754712db1bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:48.772424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-27b478bd-f911-44f5-a00a-754712db1bfc None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:48.773703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-27b478bd-f911-44f5-a00a-754712db1bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:48.802192 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:48.845858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 572/1148] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:49.122844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4ea70-bdec-4f4d-aa6d-74e3f711f8c5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:49.276204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4ea70-bdec-4f4d-aa6d-74e3f711f8c5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:49.325401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cbd72-bb5c-4d98-a379-7dc792c535cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:49.326098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cbd72-bb5c-4d98-a379-7dc792c535cf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:49.326447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cbd72-bb5c-4d98-a379-7dc792c535cf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:49.326758 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cbd72-bb5c-4d98-a379-7dc792c535cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:49.340546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cbd72-bb5c-4d98-a379-7dc792c535cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-af7cbd72-bb5c-4d98-a379-7dc792c535cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:20:49.346245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:49.347473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:49.348610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 577/1149] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:49.354752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b478bd-f911-44f5-a00a-754712db1bfc None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:49.471102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b478bd-f911-44f5-a00a-754712db1bfc None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:49.507556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbb18c-8b28-4ce5-98a5-9b7275821564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:49.508195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbb18c-8b28-4ce5-98a5-9b7275821564 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:49.508466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbb18c-8b28-4ce5-98a5-9b7275821564 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:49.508739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbb18c-8b28-4ce5-98a5-9b7275821564 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:49.509435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbb18c-8b28-4ce5-98a5-9b7275821564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:49.509736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbb18c-8b28-4ce5-98a5-9b7275821564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:49.511176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbb18c-8b28-4ce5-98a5-9b7275821564 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:49.520638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 573/1150] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:49.526867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cbd72-bb5c-4d98-a379-7dc792c535cf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:49.545032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:49.642041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cbd72-bb5c-4d98-a379-7dc792c535cf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:49.678085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa1bc3-fc00-43bf-9618-10f65f5bb885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:49.678771 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa1bc3-fc00-43bf-9618-10f65f5bb885 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:49.679055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa1bc3-fc00-43bf-9618-10f65f5bb885 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:49.679347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa1bc3-fc00-43bf-9618-10f65f5bb885 None admin] PATH_INFO: `/v3/users/4fd9d5a75266435db901a110ed911df4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:49.680557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa1bc3-fc00-43bf-9618-10f65f5bb885 None admin] RBAC: Authorizing `identity:get_user(user_id=4fd9d5a75266435db901a110ed911df4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:49.682051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa1bc3-fc00-43bf-9618-10f65f5bb885 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:49.683788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 578/1151] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:49 2022] GET /identity/v3/users/4fd9d5a75266435db901a110ed911df4 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:49.691090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbb18c-8b28-4ce5-98a5-9b7275821564 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:49.726110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:49.819614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbb18c-8b28-4ce5-98a5-9b7275821564 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:49.862571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebcd27-1687-4aca-a708-2100aabdab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:49.863256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebcd27-1687-4aca-a708-2100aabdab0b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:49.863540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebcd27-1687-4aca-a708-2100aabdab0b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:49.863806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebcd27-1687-4aca-a708-2100aabdab0b None admin] PATH_INFO: `/v3/projects/dccbb382b0494b98b3de3a63f4953218` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:49.865068 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebcd27-1687-4aca-a708-2100aabdab0b None admin] RBAC: Authorizing `identity:get_project(project_id=dccbb382b0494b98b3de3a63f4953218)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:49.866587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebcd27-1687-4aca-a708-2100aabdab0b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:49.868400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 574/1152] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:20:49 2022] GET /identity/v3/projects/dccbb382b0494b98b3de3a63f4953218 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:49.878221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa1bc3-fc00-43bf-9618-10f65f5bb885 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:49.973447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:49.994897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa1bc3-fc00-43bf-9618-10f65f5bb885 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:50.034806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e8bb4-61ce-473c-b2c1-1598e78daaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:50.035502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8bb4-61ce-473c-b2c1-1598e78daaf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:50.035782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8bb4-61ce-473c-b2c1-1598e78daaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:50.036055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8bb4-61ce-473c-b2c1-1598e78daaf2 None admin] PATH_INFO: `/v3/projects/dccbb382b0494b98b3de3a63f4953218/users/4fd9d5a75266435db901a110ed911df4/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:50.038151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e8bb4-61ce-473c-b2c1-1598e78daaf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=dccbb382b0494b98b3de3a63f4953218, user_id=4fd9d5a75266435db901a110ed911df4, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:50.039731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e8bb4-61ce-473c-b2c1-1598e78daaf2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:50.056322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 579/1153] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:20:49 2022] PUT /identity/v3/projects/dccbb382b0494b98b3de3a63f4953218/users/4fd9d5a75266435db901a110ed911df4/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:20:52.413416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bea10-3ac5-48d9-8441-7e2319c847a2 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:52.414022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bea10-3ac5-48d9-8441-7e2319c847a2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:52.414022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bea10-3ac5-48d9-8441-7e2319c847a2 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:52.415642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 575/1154] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:52.423074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa05da-4367-4457-87ff-aa7ded6df712 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:52.424100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa05da-4367-4457-87ff-aa7ded6df712 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:52.424100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa05da-4367-4457-87ff-aa7ded6df712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:52.450634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-92aa05da-4367-4457-87ff-aa7ded6df712 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:52.451979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92aa05da-4367-4457-87ff-aa7ded6df712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:52.525259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 580/1155] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:52.797144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bea10-3ac5-48d9-8441-7e2319c847a2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:52.901408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:52.913336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bea10-3ac5-48d9-8441-7e2319c847a2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:52.954510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0f733-5036-4111-84e8-2d2235709c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:52.955575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0f733-5036-4111-84e8-2d2235709c3c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:52.955857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0f733-5036-4111-84e8-2d2235709c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:52.956150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0f733-5036-4111-84e8-2d2235709c3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:52.970583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0f733-5036-4111-84e8-2d2235709c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-78a0f733-5036-4111-84e8-2d2235709c3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:20:52.975866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:52.977009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:20:52.978066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 576/1156] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:52.984119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa05da-4367-4457-87ff-aa7ded6df712 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:53.063458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:53.098016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa05da-4367-4457-87ff-aa7ded6df712 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:53.134694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa736bb-7fa0-4058-88f3-541f973c9217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:53.135325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa736bb-7fa0-4058-88f3-541f973c9217 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:53.135602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa736bb-7fa0-4058-88f3-541f973c9217 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:53.135880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa736bb-7fa0-4058-88f3-541f973c9217 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:53.136573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa736bb-7fa0-4058-88f3-541f973c9217 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:53.136886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa736bb-7fa0-4058-88f3-541f973c9217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:53.138299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa736bb-7fa0-4058-88f3-541f973c9217 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:53.147562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 581/1157] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:20:53.154064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0f733-5036-4111-84e8-2d2235709c3c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:53.280367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0f733-5036-4111-84e8-2d2235709c3c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:53.317601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166bce7-ad08-42bc-befe-26959a831290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:53.318181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166bce7-ad08-42bc-befe-26959a831290 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:53.318461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166bce7-ad08-42bc-befe-26959a831290 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:53.318765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166bce7-ad08-42bc-befe-26959a831290 None admin] PATH_INFO: `/v3/users/4fd9d5a75266435db901a110ed911df4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:53.320048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166bce7-ad08-42bc-befe-26959a831290 None admin] RBAC: Authorizing `identity:get_user(user_id=4fd9d5a75266435db901a110ed911df4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:53.321688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166bce7-ad08-42bc-befe-26959a831290 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:53.323879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 577/1158] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:20:53 2022] GET /identity/v3/users/4fd9d5a75266435db901a110ed911df4 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:53.331205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa736bb-7fa0-4058-88f3-541f973c9217 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:53.450874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa736bb-7fa0-4058-88f3-541f973c9217 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:53.490284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde24bb-607b-44eb-b29b-209d9414d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:53.491078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde24bb-607b-44eb-b29b-209d9414d8ce None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:53.491357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde24bb-607b-44eb-b29b-209d9414d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:53.491628 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde24bb-607b-44eb-b29b-209d9414d8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:53.494677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:53.567527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde24bb-607b-44eb-b29b-209d9414d8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:53.569059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde24bb-607b-44eb-b29b-209d9414d8ce None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:53.679374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 582/1159] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:53.685729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166bce7-ad08-42bc-befe-26959a831290 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:53.710476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:53.792559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166bce7-ad08-42bc-befe-26959a831290 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:53.841052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cb6eb-6f48-41be-93be-e8ebf0027544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:53.841608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cb6eb-6f48-41be-93be-e8ebf0027544 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:53.841883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cb6eb-6f48-41be-93be-e8ebf0027544 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:53.842154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cb6eb-6f48-41be-93be-e8ebf0027544 None admin] PATH_INFO: `/v3/projects/dccbb382b0494b98b3de3a63f4953218` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:53.843365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cb6eb-6f48-41be-93be-e8ebf0027544 None admin] RBAC: Authorizing `identity:get_project(project_id=dccbb382b0494b98b3de3a63f4953218)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:53.844910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cb6eb-6f48-41be-93be-e8ebf0027544 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:53.846597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 578/1160] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:20:53 2022] GET /identity/v3/projects/dccbb382b0494b98b3de3a63f4953218 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:53.853217 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde24bb-607b-44eb-b29b-209d9414d8ce None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:53.887158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:53.954304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde24bb-607b-44eb-b29b-209d9414d8ce None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:53.990294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9546e2-3494-41de-ba2f-2f31c956c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:53.990928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9546e2-3494-41de-ba2f-2f31c956c270 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:53.991203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9546e2-3494-41de-ba2f-2f31c956c270 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:53.991521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9546e2-3494-41de-ba2f-2f31c956c270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:53.992201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9546e2-3494-41de-ba2f-2f31c956c270 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=dccbb382b0494b98b3de3a63f4953218, user.id=4fd9d5a75266435db901a110ed911df4) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:53.992503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9546e2-3494-41de-ba2f-2f31c956c270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:53.993942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9546e2-3494-41de-ba2f-2f31c956c270 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:53.999866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 583/1161] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:20:53 2022] GET /identity/v3/role_assignments?user.id=4fd9d5a75266435db901a110ed911df4&scope.project.id=dccbb382b0494b98b3de3a63f4953218&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:55.948662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a2b1e-2ab8-408b-b3ea-2b726892b867 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:55.949263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a2b1e-2ab8-408b-b3ea-2b726892b867 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:55.949263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a2b1e-2ab8-408b-b3ea-2b726892b867 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:55.950554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 579/1162] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:55.956528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7aca-ff45-4eea-9682-9506ca174444 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:55.957189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7aca-ff45-4eea-9682-9506ca174444 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:55.957189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7aca-ff45-4eea-9682-9506ca174444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:55.977332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ee2d7aca-ff45-4eea-9682-9506ca174444 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:55.978536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ee2d7aca-ff45-4eea-9682-9506ca174444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:56.055873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 584/1163] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:56.339053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a2b1e-2ab8-408b-b3ea-2b726892b867 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:56.446274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:56.462178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a2b1e-2ab8-408b-b3ea-2b726892b867 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:56.498361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcb3bd-a246-4d6a-950a-af1c73612aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:56.499007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcb3bd-a246-4d6a-950a-af1c73612aee None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:56.499267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcb3bd-a246-4d6a-950a-af1c73612aee None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:56.499553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcb3bd-a246-4d6a-950a-af1c73612aee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:56.577365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcb3bd-a246-4d6a-950a-af1c73612aee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:56.578905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcb3bd-a246-4d6a-950a-af1c73612aee None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:56.672184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:56.687820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 580/1164] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:20:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:20:56.694940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d7aca-ff45-4eea-9682-9506ca174444 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:56.730475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:56.809756 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d7aca-ff45-4eea-9682-9506ca174444 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:56.845658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff2b0a-a474-407f-8490-79c7aa342311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:56.846278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff2b0a-a474-407f-8490-79c7aa342311 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:56.846562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff2b0a-a474-407f-8490-79c7aa342311 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:56.846852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff2b0a-a474-407f-8490-79c7aa342311 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:56.854008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff2b0a-a474-407f-8490-79c7aa342311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:56.855474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff2b0a-a474-407f-8490-79c7aa342311 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e4ff2b0a-a474-407f-8490-79c7aa342311 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:20:56.867466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:20:56.868749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:20:56.869821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 585/1165] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:20:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:20:56.875070 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcb3bd-a246-4d6a-950a-af1c73612aee None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:56.978172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcb3bd-a246-4d6a-950a-af1c73612aee None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:57.014898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304acde-7e9e-4dcb-b1fd-93bd5a744c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:57.015551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304acde-7e9e-4dcb-b1fd-93bd5a744c60 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:57.015914 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304acde-7e9e-4dcb-b1fd-93bd5a744c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:57.016282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304acde-7e9e-4dcb-b1fd-93bd5a744c60 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:57.017488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304acde-7e9e-4dcb-b1fd-93bd5a744c60 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:20:57.017847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304acde-7e9e-4dcb-b1fd-93bd5a744c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:57.019262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304acde-7e9e-4dcb-b1fd-93bd5a744c60 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:57.027401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 581/1166] 10.222.0.78 () {56 vars in 1115 bytes} [Wed Aug 24 03:20:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:20:58.994522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d5118-a230-4d2a-a037-7ab32d1c670a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:58.995107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d5118-a230-4d2a-a037-7ab32d1c670a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:58.995107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d5118-a230-4d2a-a037-7ab32d1c670a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:58.996487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 586/1167] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:20:59.002619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e18dc-66f5-483d-9698-801e57fd63a2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:59.003139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e18dc-66f5-483d-9698-801e57fd63a2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:59.003229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e18dc-66f5-483d-9698-801e57fd63a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:59.022172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d06e18dc-66f5-483d-9698-801e57fd63a2 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:20:59.023418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d06e18dc-66f5-483d-9698-801e57fd63a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:20:59.074588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:59.096578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 582/1168] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:20:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:20:59.366054 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d5118-a230-4d2a-a037-7ab32d1c670a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:20:59.463145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:59.478624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d5118-a230-4d2a-a037-7ab32d1c670a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:20:59.518230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1e76d-8eff-4df4-a483-c4efd3684659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:20:59.518870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1e76d-8eff-4df4-a483-c4efd3684659 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:20:59.519197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1e76d-8eff-4df4-a483-c4efd3684659 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:20:59.519460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1e76d-8eff-4df4-a483-c4efd3684659 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:20:59.520131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1e76d-8eff-4df4-a483-c4efd3684659 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:20:59.521495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1e76d-8eff-4df4-a483-c4efd3684659 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:20:59.542535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 587/1169] 10.222.0.78 () {60 vars in 1138 bytes} [Wed Aug 24 03:20:59 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:21:01.589425 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062c9d0-13b7-4b53-8a39-3fcd76d15ca9 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:01.590210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062c9d0-13b7-4b53-8a39-3fcd76d15ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:01.590210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062c9d0-13b7-4b53-8a39-3fcd76d15ca9 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:01.591356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 583/1170] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:21:01.598880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bd673-bf8d-4264-a348-8f4bf9e777b3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:01.599397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bd673-bf8d-4264-a348-8f4bf9e777b3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:01.599517 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bd673-bf8d-4264-a348-8f4bf9e777b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:01.619621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6d4bd673-bf8d-4264-a348-8f4bf9e777b3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:21:01.620864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6d4bd673-bf8d-4264-a348-8f4bf9e777b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:21:01.695842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 588/1171] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:21:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:21:01.962560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062c9d0-13b7-4b53-8a39-3fcd76d15ca9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:02.073618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062c9d0-13b7-4b53-8a39-3fcd76d15ca9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:02.109790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aa1a6-225e-4974-817f-5686e856c651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:02.110445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aa1a6-225e-4974-817f-5686e856c651 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:02.110744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aa1a6-225e-4974-817f-5686e856c651 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:02.111018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aa1a6-225e-4974-817f-5686e856c651 None admin] PATH_INFO: `/v3/domains/fbccb861f1834fb8a9b9ee68a53a3ee1` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:02.122306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aa1a6-225e-4974-817f-5686e856c651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fbccb861f1834fb8a9b9ee68a53a3ee1)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:02.123823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aa1a6-225e-4974-817f-5686e856c651 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:02.125693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 584/1172] 10.222.0.78 () {56 vars in 1183 bytes} [Wed Aug 24 03:21:01 2022] GET /identity/v3/domains/fbccb861f1834fb8a9b9ee68a53a3ee1 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:02.132194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bd673-bf8d-4264-a348-8f4bf9e777b3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:02.235967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:02.268822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bd673-bf8d-4264-a348-8f4bf9e777b3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:02.311689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959de31-0e2c-4bf9-80d7-cf04157964ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:02.312395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959de31-0e2c-4bf9-80d7-cf04157964ff None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:02.312741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959de31-0e2c-4bf9-80d7-cf04157964ff None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:02.313598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959de31-0e2c-4bf9-80d7-cf04157964ff None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:02.314332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959de31-0e2c-4bf9-80d7-cf04157964ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:02.315924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959de31-0e2c-4bf9-80d7-cf04157964ff None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:02.350687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 589/1173] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:21:02 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:21:04.347784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec89f2-d0f8-4e15-9142-179ae718a2d5 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:04.348518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec89f2-d0f8-4e15-9142-179ae718a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:04.348518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec89f2-d0f8-4e15-9142-179ae718a2d5 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:04.349904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 585/1174] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:21:04.356198 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55993f2-b8fd-4539-8885-b97afc54fec9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:04.356854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55993f2-b8fd-4539-8885-b97afc54fec9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:04.356854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55993f2-b8fd-4539-8885-b97afc54fec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:04.378326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e55993f2-b8fd-4539-8885-b97afc54fec9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:21:04.379579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e55993f2-b8fd-4539-8885-b97afc54fec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:21:04.452464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 590/1175] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:21:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:21:04.719047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec89f2-d0f8-4e15-9142-179ae718a2d5 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:04.776565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:04.837152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec89f2-d0f8-4e15-9142-179ae718a2d5 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:04.871921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a552bd-147f-403f-8a49-1f64df5899d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:04.872461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a552bd-147f-403f-8a49-1f64df5899d7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:04.872729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a552bd-147f-403f-8a49-1f64df5899d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:04.872994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a552bd-147f-403f-8a49-1f64df5899d7 None admin] PATH_INFO: `/v3/domains/fbccb861f1834fb8a9b9ee68a53a3ee1` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:04.874160 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a552bd-147f-403f-8a49-1f64df5899d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fbccb861f1834fb8a9b9ee68a53a3ee1)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:04.875852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a552bd-147f-403f-8a49-1f64df5899d7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:04.877533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 586/1176] 10.222.0.78 () {56 vars in 1183 bytes} [Wed Aug 24 03:21:04 2022] GET /identity/v3/domains/fbccb861f1834fb8a9b9ee68a53a3ee1 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:04.883466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55993f2-b8fd-4539-8885-b97afc54fec9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:04.947264 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:04.991853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55993f2-b8fd-4539-8885-b97afc54fec9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:05.031517 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47616890-abf7-4d32-a3ef-b46fdbc21d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:05.032187 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47616890-abf7-4d32-a3ef-b46fdbc21d52 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:05.032463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47616890-abf7-4d32-a3ef-b46fdbc21d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:05.032728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47616890-abf7-4d32-a3ef-b46fdbc21d52 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:05.033383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47616890-abf7-4d32-a3ef-b46fdbc21d52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:05.034875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47616890-abf7-4d32-a3ef-b46fdbc21d52 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:05.066959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 591/1177] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:21:04 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:21:07.023117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f3a7-1e5d-459e-b1d2-33afb252cf41 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:07.023674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f3a7-1e5d-459e-b1d2-33afb252cf41 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:07.023674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f3a7-1e5d-459e-b1d2-33afb252cf41 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:07.025000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 587/1178] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:21:07.030837 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0a2d-cab4-4996-b675-434c6281f7db None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:07.031339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0a2d-cab4-4996-b675-434c6281f7db None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:07.031500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0a2d-cab4-4996-b675-434c6281f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:07.058768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1a3e0a2d-cab4-4996-b675-434c6281f7db None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:21:07.059995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1a3e0a2d-cab4-4996-b675-434c6281f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:21:07.150472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 592/1179] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:21:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:21:07.417480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f3a7-1e5d-459e-b1d2-33afb252cf41 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:07.527749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f3a7-1e5d-459e-b1d2-33afb252cf41 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:07.538957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:07.565361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec99afc-6428-4ca0-a48b-272f0940ad85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:07.565999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec99afc-6428-4ca0-a48b-272f0940ad85 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:07.566313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec99afc-6428-4ca0-a48b-272f0940ad85 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:07.566508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec99afc-6428-4ca0-a48b-272f0940ad85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:07.578308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec99afc-6428-4ca0-a48b-272f0940ad85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4ec99afc-6428-4ca0-a48b-272f0940ad85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:21:07.583281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:21:07.584442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:21:07.585484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:21:07.586832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 588/1180] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:21:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:21:07.590929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0a2d-cab4-4996-b675-434c6281f7db None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:07.674249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:07.736307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0a2d-cab4-4996-b675-434c6281f7db None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:07.787099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f8d4-67dc-4fbc-a11f-c703d351d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:07.787733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f8d4-67dc-4fbc-a11f-c703d351d104 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:07.788008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f8d4-67dc-4fbc-a11f-c703d351d104 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:07.788280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f8d4-67dc-4fbc-a11f-c703d351d104 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:07.788960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f8d4-67dc-4fbc-a11f-c703d351d104 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:21:07.789261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f8d4-67dc-4fbc-a11f-c703d351d104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:07.790757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f8d4-67dc-4fbc-a11f-c703d351d104 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:07.800871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 593/1181] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:21:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:07.808206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec99afc-6428-4ca0-a48b-272f0940ad85 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:07.929820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec99afc-6428-4ca0-a48b-272f0940ad85 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:07.968510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608fd04-2030-42c7-b963-4740262da8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:07.969269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608fd04-2030-42c7-b963-4740262da8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:07.969551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608fd04-2030-42c7-b963-4740262da8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:07.969817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608fd04-2030-42c7-b963-4740262da8b6 None admin] PATH_INFO: `/v3/users/947e505ee0004bb6a819aa7968448ffd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:07.983880 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608fd04-2030-42c7-b963-4740262da8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=947e505ee0004bb6a819aa7968448ffd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:07.985331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608fd04-2030-42c7-b963-4740262da8b6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:07.987047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 589/1182] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:21:07 2022] GET /identity/v3/users/947e505ee0004bb6a819aa7968448ffd => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:07.994293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f8d4-67dc-4fbc-a11f-c703d351d104 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:08.111205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f8d4-67dc-4fbc-a11f-c703d351d104 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:08.121898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:08.167711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12d718-357c-434b-92b2-1f4a7c6ab90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:08.168353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12d718-357c-434b-92b2-1f4a7c6ab90f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:08.168632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12d718-357c-434b-92b2-1f4a7c6ab90f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:08.168902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12d718-357c-434b-92b2-1f4a7c6ab90f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:08.257591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12d718-357c-434b-92b2-1f4a7c6ab90f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:08.258997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12d718-357c-434b-92b2-1f4a7c6ab90f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:08.382215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 594/1183] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:21:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:21:08.388610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608fd04-2030-42c7-b963-4740262da8b6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:08.423651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:08.517797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608fd04-2030-42c7-b963-4740262da8b6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:08.552585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f41c7b-abdd-4085-af61-78c640525250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:08.553222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41c7b-abdd-4085-af61-78c640525250 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:08.553495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41c7b-abdd-4085-af61-78c640525250 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:08.553765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41c7b-abdd-4085-af61-78c640525250 None admin] PATH_INFO: `/v3/projects/bf621c21ea7c4fa5ae7a84e62921d1e7` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:08.554968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f41c7b-abdd-4085-af61-78c640525250 None admin] RBAC: Authorizing `identity:get_project(project_id=bf621c21ea7c4fa5ae7a84e62921d1e7)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:08.556411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f41c7b-abdd-4085-af61-78c640525250 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:08.558048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 590/1184] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:21:08 2022] GET /identity/v3/projects/bf621c21ea7c4fa5ae7a84e62921d1e7 => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:08.564597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12d718-357c-434b-92b2-1f4a7c6ab90f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:08.576173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:08.682336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12d718-357c-434b-92b2-1f4a7c6ab90f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:08.720646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177527f-b095-445d-a929-1758d789b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:08.721252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177527f-b095-445d-a929-1758d789b57d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:08.721530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177527f-b095-445d-a929-1758d789b57d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:08.721799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177527f-b095-445d-a929-1758d789b57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:08.722529 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177527f-b095-445d-a929-1758d789b57d None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=bf621c21ea7c4fa5ae7a84e62921d1e7, user.id=947e505ee0004bb6a819aa7968448ffd) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:21:08.723031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177527f-b095-445d-a929-1758d789b57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:08.724466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177527f-b095-445d-a929-1758d789b57d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:08.729998 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 595/1185] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:21:08 2022] GET /identity/v3/role_assignments?user.id=947e505ee0004bb6a819aa7968448ffd&scope.project.id=bf621c21ea7c4fa5ae7a84e62921d1e7&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:10.695069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c549-3a8b-4424-98be-ede93e2e5494 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:10.695623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c549-3a8b-4424-98be-ede93e2e5494 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:10.695623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c549-3a8b-4424-98be-ede93e2e5494 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:10.697315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 591/1186] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:21:10.705625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f5ebf-2cd9-4bc5-a01c-8cf79bc5b90e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:10.706153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f5ebf-2cd9-4bc5-a01c-8cf79bc5b90e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:10.706604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f5ebf-2cd9-4bc5-a01c-8cf79bc5b90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:10.737159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-662f5ebf-2cd9-4bc5-a01c-8cf79bc5b90e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:21:10.738425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-662f5ebf-2cd9-4bc5-a01c-8cf79bc5b90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:21:10.815540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 596/1187] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:21:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:21:11.084730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059c549-3a8b-4424-98be-ede93e2e5494 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:11.187565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:11.195381 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059c549-3a8b-4424-98be-ede93e2e5494 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:11.233080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ce9fb-4d14-4649-b6d9-454be1cc3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:11.233726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ce9fb-4d14-4649-b6d9-454be1cc3959 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:11.233996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ce9fb-4d14-4649-b6d9-454be1cc3959 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:11.234263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ce9fb-4d14-4649-b6d9-454be1cc3959 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:11.245774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ce9fb-4d14-4649-b6d9-454be1cc3959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-2c5ce9fb-4d14-4649-b6d9-454be1cc3959 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:21:11.251250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:21:11.252435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:21:11.253286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 592/1188] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:21:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:21:11.259075 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f5ebf-2cd9-4bc5-a01c-8cf79bc5b90e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:11.261457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:11.364449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f5ebf-2cd9-4bc5-a01c-8cf79bc5b90e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:11.399964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62521f4-18f2-43b4-8e94-4b2d0d581926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:11.400569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62521f4-18f2-43b4-8e94-4b2d0d581926 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:11.400839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62521f4-18f2-43b4-8e94-4b2d0d581926 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:11.401103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62521f4-18f2-43b4-8e94-4b2d0d581926 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:11.401763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62521f4-18f2-43b4-8e94-4b2d0d581926 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:21:11.402059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62521f4-18f2-43b4-8e94-4b2d0d581926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:11.403450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62521f4-18f2-43b4-8e94-4b2d0d581926 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:11.412603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 597/1189] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:21:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:11.418975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ce9fb-4d14-4649-b6d9-454be1cc3959 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:11.537940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ce9fb-4d14-4649-b6d9-454be1cc3959 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:11.574600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f09f-108c-47a3-998e-ca512dbc8e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:11.575374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f09f-108c-47a3-998e-ca512dbc8e00 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:11.575654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f09f-108c-47a3-998e-ca512dbc8e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:11.575920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f09f-108c-47a3-998e-ca512dbc8e00 None admin] PATH_INFO: `/v3/users/947e505ee0004bb6a819aa7968448ffd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:11.577106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f09f-108c-47a3-998e-ca512dbc8e00 None admin] RBAC: Authorizing `identity:get_user(user_id=947e505ee0004bb6a819aa7968448ffd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:11.578694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f09f-108c-47a3-998e-ca512dbc8e00 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:11.580523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 593/1190] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:21:11 2022] GET /identity/v3/users/947e505ee0004bb6a819aa7968448ffd => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:11.587230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62521f4-18f2-43b4-8e94-4b2d0d581926 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:11.660187 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:11.703259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62521f4-18f2-43b4-8e94-4b2d0d581926 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:11.743601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f71a6c-edfb-4a74-8eb0-20a188ec999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:11.744284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f71a6c-edfb-4a74-8eb0-20a188ec999a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:11.744496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f71a6c-edfb-4a74-8eb0-20a188ec999a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:11.744770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f71a6c-edfb-4a74-8eb0-20a188ec999a None admin] PATH_INFO: `/v3/projects/bf621c21ea7c4fa5ae7a84e62921d1e7` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:11.745944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f71a6c-edfb-4a74-8eb0-20a188ec999a None admin] RBAC: Authorizing `identity:get_project(project_id=bf621c21ea7c4fa5ae7a84e62921d1e7)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:11.747418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f71a6c-edfb-4a74-8eb0-20a188ec999a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:11.749084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 598/1191] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:21:11 2022] GET /identity/v3/projects/bf621c21ea7c4fa5ae7a84e62921d1e7 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:11.756299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f09f-108c-47a3-998e-ca512dbc8e00 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:11.785517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:11.866748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f09f-108c-47a3-998e-ca512dbc8e00 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:11.903723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd9ba3-4049-436b-b0cd-18a50ace4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:11.904380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd9ba3-4049-436b-b0cd-18a50ace4153 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:11.904658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd9ba3-4049-436b-b0cd-18a50ace4153 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:11.904924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd9ba3-4049-436b-b0cd-18a50ace4153 None admin] PATH_INFO: `/v3/projects/bf621c21ea7c4fa5ae7a84e62921d1e7/users/947e505ee0004bb6a819aa7968448ffd/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:11.907179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd9ba3-4049-436b-b0cd-18a50ace4153 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf621c21ea7c4fa5ae7a84e62921d1e7, user_id=947e505ee0004bb6a819aa7968448ffd, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:11.909257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd9ba3-4049-436b-b0cd-18a50ace4153 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:11.925026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 594/1192] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:21:11 2022] PUT /identity/v3/projects/bf621c21ea7c4fa5ae7a84e62921d1e7/users/947e505ee0004bb6a819aa7968448ffd/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:21:13.851674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612ca1e-b608-4810-abe7-1a2baba1113b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:13.852266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612ca1e-b608-4810-abe7-1a2baba1113b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:13.852266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612ca1e-b608-4810-abe7-1a2baba1113b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:13.853549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 599/1193] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:21:13.858973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e17c6-bfbf-4b15-81c3-e683d3ba6538 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:13.859413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e17c6-bfbf-4b15-81c3-e683d3ba6538 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:13.859542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e17c6-bfbf-4b15-81c3-e683d3ba6538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:13.878996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ea6e17c6-bfbf-4b15-81c3-e683d3ba6538 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:21:13.880128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ea6e17c6-bfbf-4b15-81c3-e683d3ba6538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:21:13.959890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 595/1194] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:21:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:21:14.237741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612ca1e-b608-4810-abe7-1a2baba1113b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:14.358043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612ca1e-b608-4810-abe7-1a2baba1113b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:14.392920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:14.398918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffbe40-1923-491c-a60f-5b130e77aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:14.399554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffbe40-1923-491c-a60f-5b130e77aed1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:14.399830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffbe40-1923-491c-a60f-5b130e77aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:14.400087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffbe40-1923-491c-a60f-5b130e77aed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:14.416087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffbe40-1923-491c-a60f-5b130e77aed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b3ffbe40-1923-491c-a60f-5b130e77aed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:21:14.420861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:21:14.421931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:21:14.423522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 600/1195] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:21:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:21:14.428930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e17c6-bfbf-4b15-81c3-e683d3ba6538 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:14.453559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:14.543933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e17c6-bfbf-4b15-81c3-e683d3ba6538 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:14.580120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e2706-efa6-450e-be35-ded68d341d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:14.580737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e2706-efa6-450e-be35-ded68d341d61 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:14.581010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e2706-efa6-450e-be35-ded68d341d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:14.581258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e2706-efa6-450e-be35-ded68d341d61 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:14.581931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e2706-efa6-450e-be35-ded68d341d61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:21:14.582228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e2706-efa6-450e-be35-ded68d341d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:14.583623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e2706-efa6-450e-be35-ded68d341d61 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:14.592091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 596/1196] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:21:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:14.598354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffbe40-1923-491c-a60f-5b130e77aed1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:14.708995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffbe40-1923-491c-a60f-5b130e77aed1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:14.745945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d79a9-aa09-4f46-b303-8d23fbdc8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:14.746577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d79a9-aa09-4f46-b303-8d23fbdc8066 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:14.746882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d79a9-aa09-4f46-b303-8d23fbdc8066 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:14.747155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d79a9-aa09-4f46-b303-8d23fbdc8066 None admin] PATH_INFO: `/v3/users/947e505ee0004bb6a819aa7968448ffd` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:14.748343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d79a9-aa09-4f46-b303-8d23fbdc8066 None admin] RBAC: Authorizing `identity:get_user(user_id=947e505ee0004bb6a819aa7968448ffd)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:14.749783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d79a9-aa09-4f46-b303-8d23fbdc8066 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:14.751496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 601/1197] 10.222.0.78 () {56 vars in 1177 bytes} [Wed Aug 24 03:21:14 2022] GET /identity/v3/users/947e505ee0004bb6a819aa7968448ffd => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:14.757871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e2706-efa6-450e-be35-ded68d341d61 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:14.839716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:14.864198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e2706-efa6-450e-be35-ded68d341d61 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:14.900030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77a280-5325-440f-91b9-67c8d3ea1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:14.900648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a280-5325-440f-91b9-67c8d3ea1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:14.900920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a280-5325-440f-91b9-67c8d3ea1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:14.901184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a280-5325-440f-91b9-67c8d3ea1ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:14.972713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77a280-5325-440f-91b9-67c8d3ea1ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:14.974170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77a280-5325-440f-91b9-67c8d3ea1ce0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:15.056394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:15.081957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 597/1198] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:21:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:21:15.088157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d79a9-aa09-4f46-b303-8d23fbdc8066 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:15.151505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:15.198233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d79a9-aa09-4f46-b303-8d23fbdc8066 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:15.234055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a00d81-e550-4b51-b939-d4eb7e76fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:15.234775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a00d81-e550-4b51-b939-d4eb7e76fc54 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:15.235039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a00d81-e550-4b51-b939-d4eb7e76fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:15.235303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a00d81-e550-4b51-b939-d4eb7e76fc54 None admin] PATH_INFO: `/v3/projects/bf621c21ea7c4fa5ae7a84e62921d1e7` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:15.236660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a00d81-e550-4b51-b939-d4eb7e76fc54 None admin] RBAC: Authorizing `identity:get_project(project_id=bf621c21ea7c4fa5ae7a84e62921d1e7)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:15.238104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a00d81-e550-4b51-b939-d4eb7e76fc54 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:15.239801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 602/1199] 10.222.0.78 () {56 vars in 1186 bytes} [Wed Aug 24 03:21:15 2022] GET /identity/v3/projects/bf621c21ea7c4fa5ae7a84e62921d1e7 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:15.247258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77a280-5325-440f-91b9-67c8d3ea1ce0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:21:15.365565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77a280-5325-440f-91b9-67c8d3ea1ce0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:21:15.404433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d73a8-0e81-452d-95e1-1ca30f46bf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:21:15.404808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d73a8-0e81-452d-95e1-1ca30f46bf07 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:21:15.405086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d73a8-0e81-452d-95e1-1ca30f46bf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:21:15.405357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d73a8-0e81-452d-95e1-1ca30f46bf07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:21:15.406094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d73a8-0e81-452d-95e1-1ca30f46bf07 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=bf621c21ea7c4fa5ae7a84e62921d1e7, user.id=947e505ee0004bb6a819aa7968448ffd) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:21:15.406562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d73a8-0e81-452d-95e1-1ca30f46bf07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:21:15.408119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d73a8-0e81-452d-95e1-1ca30f46bf07 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:21:15.414796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 598/1200] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:21:15 2022] GET /identity/v3/role_assignments?user.id=947e505ee0004bb6a819aa7968448ffd&scope.project.id=bf621c21ea7c4fa5ae7a84e62921d1e7&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:21:25.229619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=36 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:25.411692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=80 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:12.382257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524a4d-eea0-4775-8713-938645aea56a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:12.382914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524a4d-eea0-4775-8713-938645aea56a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:12.382914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524a4d-eea0-4775-8713-938645aea56a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:12.384297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 603/1201] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:12.391299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4eb0d-a002-48a6-9347-9bf351fe6d52 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:12.391941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4eb0d-a002-48a6-9347-9bf351fe6d52 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:12.392101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4eb0d-a002-48a6-9347-9bf351fe6d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:12.413072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6da4eb0d-a002-48a6-9347-9bf351fe6d52 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:12.414266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6da4eb0d-a002-48a6-9347-9bf351fe6d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:12.512187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 599/1202] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:22:12.797658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b524a4d-eea0-4775-8713-938645aea56a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:12.933102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b524a4d-eea0-4775-8713-938645aea56a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:12.983450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21924e34-e291-4ab4-b5ea-82245cc17463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:12.984124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21924e34-e291-4ab4-b5ea-82245cc17463 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:12.984454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21924e34-e291-4ab4-b5ea-82245cc17463 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:12.984716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21924e34-e291-4ab4-b5ea-82245cc17463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:12.999479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21924e34-e291-4ab4-b5ea-82245cc17463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:13.003235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21924e34-e291-4ab4-b5ea-82245cc17463 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-21924e34-e291-4ab4-b5ea-82245cc17463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:13.022558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:13.023722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:13.024883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:13.024883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:13.024883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:13.024883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 604/1203] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:13.031898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4eb0d-a002-48a6-9347-9bf351fe6d52 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:13.180834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4eb0d-a002-48a6-9347-9bf351fe6d52 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:13.221071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:13.228716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd86381-2bc6-43fe-88bb-68fbae3a0700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:13.229479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd86381-2bc6-43fe-88bb-68fbae3a0700 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:13.229813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd86381-2bc6-43fe-88bb-68fbae3a0700 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:13.229961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd86381-2bc6-43fe-88bb-68fbae3a0700 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:13.230629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd86381-2bc6-43fe-88bb-68fbae3a0700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:13.230955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd86381-2bc6-43fe-88bb-68fbae3a0700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:13.232382 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd86381-2bc6-43fe-88bb-68fbae3a0700 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:13.251066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 600/1204] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:22:13.257281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21924e34-e291-4ab4-b5ea-82245cc17463 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:13.324930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:13.382506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21924e34-e291-4ab4-b5ea-82245cc17463 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:13.420859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01feaa-3b28-4e4e-851c-ff0c759805d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:13.421537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01feaa-3b28-4e4e-851c-ff0c759805d7 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:13.421768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01feaa-3b28-4e4e-851c-ff0c759805d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:13.422037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01feaa-3b28-4e4e-851c-ff0c759805d7 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:13.422710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01feaa-3b28-4e4e-851c-ff0c759805d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:13.424190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01feaa-3b28-4e4e-851c-ff0c759805d7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:13.459486 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 605/1205] 10.222.0.78 () {60 vars in 1132 bytes} [Wed Aug 24 03:22:13 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:22:15.616350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca93194-3300-48ef-8cfb-569129cc750a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:15.616801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca93194-3300-48ef-8cfb-569129cc750a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:15.616907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca93194-3300-48ef-8cfb-569129cc750a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:15.618250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 601/1206] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:15.623921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40f4a6-a8ef-469d-a789-861f1d7c8806 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:15.624491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40f4a6-a8ef-469d-a789-861f1d7c8806 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:15.624738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40f4a6-a8ef-469d-a789-861f1d7c8806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:15.644184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-da40f4a6-a8ef-469d-a789-861f1d7c8806 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:15.645387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-da40f4a6-a8ef-469d-a789-861f1d7c8806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:15.718404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 606/1207] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:22:15.983870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca93194-3300-48ef-8cfb-569129cc750a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:16.126265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca93194-3300-48ef-8cfb-569129cc750a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:16.174248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec135c-045d-495e-8d9b-7532c1bd9a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:16.174949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec135c-045d-495e-8d9b-7532c1bd9a73 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:16.175323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec135c-045d-495e-8d9b-7532c1bd9a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:16.175583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec135c-045d-495e-8d9b-7532c1bd9a73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:16.189940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec135c-045d-495e-8d9b-7532c1bd9a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-09ec135c-045d-495e-8d9b-7532c1bd9a73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:22:16.194754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:16.196902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:16.198264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 602/1208] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:22:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:16.203263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40f4a6-a8ef-469d-a789-861f1d7c8806 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:16.258310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:16.358843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40f4a6-a8ef-469d-a789-861f1d7c8806 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:16.413842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ae44d-173b-4a26-9b12-ba8111a995fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:16.414550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ae44d-173b-4a26-9b12-ba8111a995fa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:16.414836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ae44d-173b-4a26-9b12-ba8111a995fa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:16.415105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ae44d-173b-4a26-9b12-ba8111a995fa None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:16.415854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ae44d-173b-4a26-9b12-ba8111a995fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:16.416183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ae44d-173b-4a26-9b12-ba8111a995fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:16.417755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ae44d-173b-4a26-9b12-ba8111a995fa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:16.429304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 607/1209] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:22:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:22:16.435829 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec135c-045d-495e-8d9b-7532c1bd9a73 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:16.505177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:16.572466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec135c-045d-495e-8d9b-7532c1bd9a73 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:16.619778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dea3f-66af-4346-a163-63c5bd6e684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:16.622006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dea3f-66af-4346-a163-63c5bd6e684e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:16.622006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dea3f-66af-4346-a163-63c5bd6e684e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:16.622006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dea3f-66af-4346-a163-63c5bd6e684e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:16.637836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dea3f-66af-4346-a163-63c5bd6e684e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:16.637836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dea3f-66af-4346-a163-63c5bd6e684e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-a84dea3f-66af-4346-a163-63c5bd6e684e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:16.659272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:16.660531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:16.661537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:16.661537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:16.661537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:16.661537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 603/1210] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:16.668346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ae44d-173b-4a26-9b12-ba8111a995fa None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:16.791040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:16.794877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ae44d-173b-4a26-9b12-ba8111a995fa None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:16.839590 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f2b04-7670-48e3-97fc-9aad894a9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:16.840158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f2b04-7670-48e3-97fc-9aad894a9185 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:16.840462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f2b04-7670-48e3-97fc-9aad894a9185 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:16.840770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f2b04-7670-48e3-97fc-9aad894a9185 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:16.841426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f2b04-7670-48e3-97fc-9aad894a9185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:16.841729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f2b04-7670-48e3-97fc-9aad894a9185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:16.843506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f2b04-7670-48e3-97fc-9aad894a9185 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:16.858906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 608/1211] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:16.863267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dea3f-66af-4346-a163-63c5bd6e684e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:16.989385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dea3f-66af-4346-a163-63c5bd6e684e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:16.991504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:17.038016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc0ca-4ce2-43ee-94aa-919f641ed4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:17.039273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc0ca-4ce2-43ee-94aa-919f641ed4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:17.039273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc0ca-4ce2-43ee-94aa-919f641ed4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:17.039774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc0ca-4ce2-43ee-94aa-919f641ed4f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:17.050692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc0ca-4ce2-43ee-94aa-919f641ed4f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:17.052564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc0ca-4ce2-43ee-94aa-919f641ed4f4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6b0dc0ca-4ce2-43ee-94aa-919f641ed4f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:22:17.066933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:17.068206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:17.074782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 604/1212] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:17.075560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f2b04-7670-48e3-97fc-9aad894a9185 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:17.216743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f2b04-7670-48e3-97fc-9aad894a9185 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:17.269523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85656be-33f5-4c5d-85d2-f9aa8462221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:17.270509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85656be-33f5-4c5d-85d2-f9aa8462221c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:17.270945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85656be-33f5-4c5d-85d2-f9aa8462221c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:17.271377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85656be-33f5-4c5d-85d2-f9aa8462221c None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:17.272768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85656be-33f5-4c5d-85d2-f9aa8462221c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:17.273372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85656be-33f5-4c5d-85d2-f9aa8462221c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:17.275703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85656be-33f5-4c5d-85d2-f9aa8462221c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:17.310420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 609/1213] 10.222.0.78 () {56 vars in 1143 bytes} [Wed Aug 24 03:22:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:22:17.319913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc0ca-4ce2-43ee-94aa-919f641ed4f4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:17.475623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc0ca-4ce2-43ee-94aa-919f641ed4f4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:17.522190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97307665-eaa6-4907-af31-c8516893c14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:17.522948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97307665-eaa6-4907-af31-c8516893c14c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:17.523385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97307665-eaa6-4907-af31-c8516893c14c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:17.523689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97307665-eaa6-4907-af31-c8516893c14c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:17.563100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:17.613335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97307665-eaa6-4907-af31-c8516893c14c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:17.614862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97307665-eaa6-4907-af31-c8516893c14c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:17.747190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 605/1214] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:22:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:22:17.754720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85656be-33f5-4c5d-85d2-f9aa8462221c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:17.778138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:17.888848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85656be-33f5-4c5d-85d2-f9aa8462221c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:17.931635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8094cf5-e1cc-4e4b-b0db-e6dbe6207f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:17.932382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8094cf5-e1cc-4e4b-b0db-e6dbe6207f42 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:17.933355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8094cf5-e1cc-4e4b-b0db-e6dbe6207f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:17.933355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8094cf5-e1cc-4e4b-b0db-e6dbe6207f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:17.944660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8094cf5-e1cc-4e4b-b0db-e6dbe6207f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:17.946528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8094cf5-e1cc-4e4b-b0db-e6dbe6207f42 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d8094cf5-e1cc-4e4b-b0db-e6dbe6207f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:17.965165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:17.966256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:17.967400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:17.967400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:17.967400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:17.975588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 610/1215] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:17.975748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97307665-eaa6-4907-af31-c8516893c14c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:18.045046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:18.118100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97307665-eaa6-4907-af31-c8516893c14c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:18.172564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d549807-981e-456b-96d3-49142a8a06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:18.173666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d549807-981e-456b-96d3-49142a8a06b5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:18.174215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d549807-981e-456b-96d3-49142a8a06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:18.174788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d549807-981e-456b-96d3-49142a8a06b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:18.176038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d549807-981e-456b-96d3-49142a8a06b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:18.176686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d549807-981e-456b-96d3-49142a8a06b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:18.178921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d549807-981e-456b-96d3-49142a8a06b5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:18.192992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 606/1216] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:18.200321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8094cf5-e1cc-4e4b-b0db-e6dbe6207f42 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:18.290316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:18.336196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8094cf5-e1cc-4e4b-b0db-e6dbe6207f42 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:18.379317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacadba-fdad-472b-9744-0a5479372241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:18.379945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacadba-fdad-472b-9744-0a5479372241 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:18.380354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacadba-fdad-472b-9744-0a5479372241 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:18.380623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacadba-fdad-472b-9744-0a5479372241 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:18.388178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacadba-fdad-472b-9744-0a5479372241 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:18.390139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacadba-fdad-472b-9744-0a5479372241 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6eacadba-fdad-472b-9744-0a5479372241 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:22:18.403463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:18.404715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:18.406196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:22:18.406196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:22:18.406196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:22:18.406196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:22:18.406196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:22:18.406196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:22:18.406196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:18.406196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:18.406196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 611/1217] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:22:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:18.410841 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d549807-981e-456b-96d3-49142a8a06b5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:18.551622 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d549807-981e-456b-96d3-49142a8a06b5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:18.579821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:18.595994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b7ac-e508-4282-a20b-a3eb6cb3520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:18.596538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b7ac-e508-4282-a20b-a3eb6cb3520b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:18.596814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b7ac-e508-4282-a20b-a3eb6cb3520b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:18.597079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b7ac-e508-4282-a20b-a3eb6cb3520b None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:18.597797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3b7ac-e508-4282-a20b-a3eb6cb3520b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:18.598098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3b7ac-e508-4282-a20b-a3eb6cb3520b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:18.599579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3b7ac-e508-4282-a20b-a3eb6cb3520b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:18.619820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 607/1218] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:22:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:18.621498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacadba-fdad-472b-9744-0a5479372241 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:18.736337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacadba-fdad-472b-9744-0a5479372241 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:18.769343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:18.775874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a62f4-160c-498d-b210-a489cb930245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:18.776505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a62f4-160c-498d-b210-a489cb930245 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:18.776776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a62f4-160c-498d-b210-a489cb930245 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:18.777048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a62f4-160c-498d-b210-a489cb930245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:18.777771 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a62f4-160c-498d-b210-a489cb930245 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=496b8b8fa8ad4cc59b7f3d2c48cdd977) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:18.778077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a62f4-160c-498d-b210-a489cb930245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:18.779523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a62f4-160c-498d-b210-a489cb930245 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:18.786334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 612/1219] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:22:18 2022] GET /identity/v3/role_assignments?user.id=496b8b8fa8ad4cc59b7f3d2c48cdd977&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:20.912816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eaf11-d4d7-4aba-91b5-c1e6bf816f22 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:20.913369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eaf11-d4d7-4aba-91b5-c1e6bf816f22 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:20.913369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eaf11-d4d7-4aba-91b5-c1e6bf816f22 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:20.914724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 608/1220] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:20.921592 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea74861-f676-42bf-9b27-e282d9ad77af None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:20.922211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea74861-f676-42bf-9b27-e282d9ad77af None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:20.922211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea74861-f676-42bf-9b27-e282d9ad77af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:20.944733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-eea74861-f676-42bf-9b27-e282d9ad77af None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:20.946494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-eea74861-f676-42bf-9b27-e282d9ad77af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:21.050945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 613/1221] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:22:21.327895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eaf11-d4d7-4aba-91b5-c1e6bf816f22 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:21.462853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eaf11-d4d7-4aba-91b5-c1e6bf816f22 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:21.502514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299a3a9-b561-443e-99e4-c5687c0f6296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:21.503645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299a3a9-b561-443e-99e4-c5687c0f6296 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:21.503851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299a3a9-b561-443e-99e4-c5687c0f6296 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:21.504103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299a3a9-b561-443e-99e4-c5687c0f6296 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:21.515803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299a3a9-b561-443e-99e4-c5687c0f6296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-9299a3a9-b561-443e-99e4-c5687c0f6296 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:22:21.520703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:21.522917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:21.524940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 609/1222] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:22:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:21.528118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea74861-f676-42bf-9b27-e282d9ad77af None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:21.652843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea74861-f676-42bf-9b27-e282d9ad77af None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:21.681955 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:21.693952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b62d9f-735d-4e53-9476-aefcdf464915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:21.694582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62d9f-735d-4e53-9476-aefcdf464915 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:21.694872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62d9f-735d-4e53-9476-aefcdf464915 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:21.695168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62d9f-735d-4e53-9476-aefcdf464915 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:21.695800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b62d9f-735d-4e53-9476-aefcdf464915 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:21.696464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b62d9f-735d-4e53-9476-aefcdf464915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:21.697848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b62d9f-735d-4e53-9476-aefcdf464915 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:21.707126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 614/1223] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:22:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:21.715345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299a3a9-b561-443e-99e4-c5687c0f6296 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:21.763839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:21.824853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299a3a9-b561-443e-99e4-c5687c0f6296 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:21.862181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cd438-2c87-499c-805f-110a70626dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:21.863019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cd438-2c87-499c-805f-110a70626dea None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:21.863426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cd438-2c87-499c-805f-110a70626dea None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:21.863705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cd438-2c87-499c-805f-110a70626dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:21.875626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cd438-2c87-499c-805f-110a70626dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:21.877102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cd438-2c87-499c-805f-110a70626dea None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-df9cd438-2c87-499c-805f-110a70626dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:21.892129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:21.893409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:21.894754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:21.894754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:21.894754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:21.894754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 610/1224] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:21.899446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b62d9f-735d-4e53-9476-aefcdf464915 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:22.015891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b62d9f-735d-4e53-9476-aefcdf464915 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:22.070472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4147d00-40a2-46ad-831f-ab45f9d62ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:22.071539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4147d00-40a2-46ad-831f-ab45f9d62ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:22.071885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4147d00-40a2-46ad-831f-ab45f9d62ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:22.072230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4147d00-40a2-46ad-831f-ab45f9d62ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:22.072951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4147d00-40a2-46ad-831f-ab45f9d62ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:22.073422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4147d00-40a2-46ad-831f-ab45f9d62ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:22.075212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4147d00-40a2-46ad-831f-ab45f9d62ab6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:22.091894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 615/1225] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:22.098113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cd438-2c87-499c-805f-110a70626dea None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:22.218938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:22.225752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cd438-2c87-499c-805f-110a70626dea None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:22.268897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a041ebc-42b2-4959-89c6-cd0ae3762840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:22.269579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a041ebc-42b2-4959-89c6-cd0ae3762840 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:22.269847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a041ebc-42b2-4959-89c6-cd0ae3762840 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:22.270196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a041ebc-42b2-4959-89c6-cd0ae3762840 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:22.279409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a041ebc-42b2-4959-89c6-cd0ae3762840 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:22.281045 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a041ebc-42b2-4959-89c6-cd0ae3762840 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4a041ebc-42b2-4959-89c6-cd0ae3762840 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:22:22.295341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:22.297344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:22.299289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 611/1226] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:22:22.302964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4147d00-40a2-46ad-831f-ab45f9d62ab6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:22.365896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:22.431250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4147d00-40a2-46ad-831f-ab45f9d62ab6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:22.473307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76a814-a2b0-4432-bc0c-7793c1946892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:22.474016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76a814-a2b0-4432-bc0c-7793c1946892 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:22.474543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76a814-a2b0-4432-bc0c-7793c1946892 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:22.474543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76a814-a2b0-4432-bc0c-7793c1946892 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:22.475205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76a814-a2b0-4432-bc0c-7793c1946892 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:22.475442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76a814-a2b0-4432-bc0c-7793c1946892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:22.476895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76a814-a2b0-4432-bc0c-7793c1946892 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:22.499337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 616/1227] 10.222.0.78 () {56 vars in 1143 bytes} [Wed Aug 24 03:22:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:22.505612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a041ebc-42b2-4959-89c6-cd0ae3762840 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:22.641881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a041ebc-42b2-4959-89c6-cd0ae3762840 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:22.684256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9e408-b0ce-48b8-b900-63a15139181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:22.685241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9e408-b0ce-48b8-b900-63a15139181b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:22.685607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9e408-b0ce-48b8-b900-63a15139181b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:22.686246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9e408-b0ce-48b8-b900-63a15139181b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:22.699496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9e408-b0ce-48b8-b900-63a15139181b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:22.701037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9e408-b0ce-48b8-b900-63a15139181b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-c8d9e408-b0ce-48b8-b900-63a15139181b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:22.718028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:22.719624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:22.720684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:22.720684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:22.720684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:22.720684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 612/1228] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:22.726002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76a814-a2b0-4432-bc0c-7793c1946892 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:22.848458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76a814-a2b0-4432-bc0c-7793c1946892 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:22.851015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:22.893019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a8c8d-fd0a-48c1-abbf-7f96d73d5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:22.893662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8c8d-fd0a-48c1-abbf-7f96d73d5cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:22.893932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8c8d-fd0a-48c1-abbf-7f96d73d5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:22.894235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8c8d-fd0a-48c1-abbf-7f96d73d5cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:22.895004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a8c8d-fd0a-48c1-abbf-7f96d73d5cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:22.895469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a8c8d-fd0a-48c1-abbf-7f96d73d5cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:22.896889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a8c8d-fd0a-48c1-abbf-7f96d73d5cb1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:22.911799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 617/1229] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:22.917878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9e408-b0ce-48b8-b900-63a15139181b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:22.929053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:23.039788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9e408-b0ce-48b8-b900-63a15139181b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:23.087612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fdbcc-beb2-428e-9403-2cc63a79b8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:23.088230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdbcc-beb2-428e-9403-2cc63a79b8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:23.088522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdbcc-beb2-428e-9403-2cc63a79b8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:23.088981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdbcc-beb2-428e-9403-2cc63a79b8c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:23.097000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdbcc-beb2-428e-9403-2cc63a79b8c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:23.098318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdbcc-beb2-428e-9403-2cc63a79b8c8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-403fdbcc-beb2-428e-9403-2cc63a79b8c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:22:23.112662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:23.120191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:23.121281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:22:23.121281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:22:23.121281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:22:23.121281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:22:23.121281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:22:23.121281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:22:23.121281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:23.121281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:23.121281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 613/1230] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:22:23.121816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a8c8d-fd0a-48c1-abbf-7f96d73d5cb1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:23.258851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a8c8d-fd0a-48c1-abbf-7f96d73d5cb1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:23.303527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc916c7-4f20-44a7-997c-ef435102b1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:23.304435 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc916c7-4f20-44a7-997c-ef435102b1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:23.304713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc916c7-4f20-44a7-997c-ef435102b1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:23.304986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc916c7-4f20-44a7-997c-ef435102b1f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:23.305686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc916c7-4f20-44a7-997c-ef435102b1f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:23.305985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc916c7-4f20-44a7-997c-ef435102b1f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:23.307518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc916c7-4f20-44a7-997c-ef435102b1f5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:23.322571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 618/1231] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:22:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:23.329554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fdbcc-beb2-428e-9403-2cc63a79b8c8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:23.416281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:23.467821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fdbcc-beb2-428e-9403-2cc63a79b8c8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:23.505385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985354c-83be-4c1c-b28a-f6b049790e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:23.506064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985354c-83be-4c1c-b28a-f6b049790e65 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:23.506343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985354c-83be-4c1c-b28a-f6b049790e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:23.506727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985354c-83be-4c1c-b28a-f6b049790e65 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/496b8b8fa8ad4cc59b7f3d2c48cdd977/roles/392e59acab294916b7e3713134f2a626` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:23.523303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985354c-83be-4c1c-b28a-f6b049790e65 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=496b8b8fa8ad4cc59b7f3d2c48cdd977, role_id=392e59acab294916b7e3713134f2a626)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:23.524875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985354c-83be-4c1c-b28a-f6b049790e65 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:23.540704 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 614/1232] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:22:23 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/496b8b8fa8ad4cc59b7f3d2c48cdd977/roles/392e59acab294916b7e3713134f2a626 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:22:25.711081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7197-8f72-48c0-af64-df034aa0d159 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:25.711713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7197-8f72-48c0-af64-df034aa0d159 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:25.711713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7197-8f72-48c0-af64-df034aa0d159 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:25.713004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 619/1233] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:25.718884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d093-8f00-4846-ba37-918d0d7d416e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:25.719360 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d093-8f00-4846-ba37-918d0d7d416e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:25.719454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d093-8f00-4846-ba37-918d0d7d416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:25.738821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2497d093-8f00-4846-ba37-918d0d7d416e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:25.740026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2497d093-8f00-4846-ba37-918d0d7d416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:25.821753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 615/1234] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:22:26.085330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab7197-8f72-48c0-af64-df034aa0d159 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:26.119083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:26.210925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab7197-8f72-48c0-af64-df034aa0d159 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:26.255062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2969db-82b7-4327-9f46-afbd5fa6f485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:26.255842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2969db-82b7-4327-9f46-afbd5fa6f485 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:26.256063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2969db-82b7-4327-9f46-afbd5fa6f485 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:26.256296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2969db-82b7-4327-9f46-afbd5fa6f485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:26.269918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2969db-82b7-4327-9f46-afbd5fa6f485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-2f2969db-82b7-4327-9f46-afbd5fa6f485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:22:26.274848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:26.275923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:26.277413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 620/1235] 10.222.0.78 () {56 vars in 1102 bytes} [Wed Aug 24 03:22:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:26.282979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d093-8f00-4846-ba37-918d0d7d416e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:26.340980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:26.427182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d093-8f00-4846-ba37-918d0d7d416e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:26.476374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe6fcb-a9d9-4d6d-8c03-6223305c17a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:26.477315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe6fcb-a9d9-4d6d-8c03-6223305c17a0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:26.477809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe6fcb-a9d9-4d6d-8c03-6223305c17a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:26.478220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe6fcb-a9d9-4d6d-8c03-6223305c17a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:26.479316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe6fcb-a9d9-4d6d-8c03-6223305c17a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:26.479747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe6fcb-a9d9-4d6d-8c03-6223305c17a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:26.481575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe6fcb-a9d9-4d6d-8c03-6223305c17a0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:26.495811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 616/1236] 10.222.0.78 () {56 vars in 1103 bytes} [Wed Aug 24 03:22:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:22:26.502810 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2969db-82b7-4327-9f46-afbd5fa6f485 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:26.603782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:26.624905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2969db-82b7-4327-9f46-afbd5fa6f485 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:26.666073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3d3bf-cefb-4b0f-a85b-9929b94dcfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:26.667049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3d3bf-cefb-4b0f-a85b-9929b94dcfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:26.667440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3d3bf-cefb-4b0f-a85b-9929b94dcfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:26.667979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3d3bf-cefb-4b0f-a85b-9929b94dcfe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:26.680708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3d3bf-cefb-4b0f-a85b-9929b94dcfe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:26.682289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3d3bf-cefb-4b0f-a85b-9929b94dcfe2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-98c3d3bf-cefb-4b0f-a85b-9929b94dcfe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:26.700095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:26.703737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:26.705295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:26.705295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:26.705295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:26.705295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 621/1237] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:26.709438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe6fcb-a9d9-4d6d-8c03-6223305c17a0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:26.830463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe6fcb-a9d9-4d6d-8c03-6223305c17a0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:26.840537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:26.871744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26516-47f2-4464-ac97-9065dbbde11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:26.872284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26516-47f2-4464-ac97-9065dbbde11b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:26.872561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26516-47f2-4464-ac97-9065dbbde11b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:26.872825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26516-47f2-4464-ac97-9065dbbde11b None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:26.873800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26516-47f2-4464-ac97-9065dbbde11b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:26.874111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26516-47f2-4464-ac97-9065dbbde11b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:26.875572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26516-47f2-4464-ac97-9065dbbde11b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:26.890308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 617/1238] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:22:26.896204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3d3bf-cefb-4b0f-a85b-9929b94dcfe2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:27.022079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3d3bf-cefb-4b0f-a85b-9929b94dcfe2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:27.067056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624440-d4c3-4317-be6b-3034ac3b4046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:27.067712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624440-d4c3-4317-be6b-3034ac3b4046 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:27.067992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624440-d4c3-4317-be6b-3034ac3b4046 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:27.068251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624440-d4c3-4317-be6b-3034ac3b4046 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:27.071981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:27.079433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12624440-d4c3-4317-be6b-3034ac3b4046 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:27.081728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12624440-d4c3-4317-be6b-3034ac3b4046 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-12624440-d4c3-4317-be6b-3034ac3b4046 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:22:27.094712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:27.095961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:27.097201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 622/1239] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:27.102125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26516-47f2-4464-ac97-9065dbbde11b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:27.221352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26516-47f2-4464-ac97-9065dbbde11b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:27.260098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f5795-cd60-49fe-bd5c-65d085533cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:27.260791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f5795-cd60-49fe-bd5c-65d085533cdb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:27.261071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f5795-cd60-49fe-bd5c-65d085533cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:27.261388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f5795-cd60-49fe-bd5c-65d085533cdb None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:27.262165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f5795-cd60-49fe-bd5c-65d085533cdb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:27.262477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f5795-cd60-49fe-bd5c-65d085533cdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:27.265001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f5795-cd60-49fe-bd5c-65d085533cdb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:27.286857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 618/1240] 10.222.0.78 () {56 vars in 1143 bytes} [Wed Aug 24 03:22:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:27.292603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624440-d4c3-4317-be6b-3034ac3b4046 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:27.414455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624440-d4c3-4317-be6b-3034ac3b4046 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:27.455746 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740126c-e8d8-4b64-aad5-2e112e2a5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:27.456411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740126c-e8d8-4b64-aad5-2e112e2a5594 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:27.456709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740126c-e8d8-4b64-aad5-2e112e2a5594 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:27.457061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740126c-e8d8-4b64-aad5-2e112e2a5594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:27.537384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:27.545042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740126c-e8d8-4b64-aad5-2e112e2a5594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:27.546621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740126c-e8d8-4b64-aad5-2e112e2a5594 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:27.666886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 623/1241] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:22:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:22:27.672907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f5795-cd60-49fe-bd5c-65d085533cdb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:27.705789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:27.801547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f5795-cd60-49fe-bd5c-65d085533cdb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:27.843445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5bc3-7e5a-4969-a10e-824d5289e3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:27.844988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5bc3-7e5a-4969-a10e-824d5289e3da None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:27.845329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5bc3-7e5a-4969-a10e-824d5289e3da None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:27.845642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5bc3-7e5a-4969-a10e-824d5289e3da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:27.859994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab5bc3-7e5a-4969-a10e-824d5289e3da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:27.861600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab5bc3-7e5a-4969-a10e-824d5289e3da None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6aab5bc3-7e5a-4969-a10e-824d5289e3da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:27.879646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:27.880926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:27.882017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:27.882017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:27.882017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:27.882017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 619/1242] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:27.887193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740126c-e8d8-4b64-aad5-2e112e2a5594 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:28.005537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:28.014032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740126c-e8d8-4b64-aad5-2e112e2a5594 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:28.061914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565402e-cf75-40df-b7ef-889f9d946513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:28.062470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565402e-cf75-40df-b7ef-889f9d946513 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:28.062821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565402e-cf75-40df-b7ef-889f9d946513 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:28.063124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565402e-cf75-40df-b7ef-889f9d946513 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:28.063819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565402e-cf75-40df-b7ef-889f9d946513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:28.064169 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565402e-cf75-40df-b7ef-889f9d946513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:28.065615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565402e-cf75-40df-b7ef-889f9d946513 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:28.080111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 624/1243] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:28.086249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5bc3-7e5a-4969-a10e-824d5289e3da None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:28.185235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:28.214323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5bc3-7e5a-4969-a10e-824d5289e3da None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:28.255564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a52a-2788-40ab-adfe-4607e237b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:28.256267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a52a-2788-40ab-adfe-4607e237b65c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:28.256609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a52a-2788-40ab-adfe-4607e237b65c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:28.256941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5a52a-2788-40ab-adfe-4607e237b65c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:28.265130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5a52a-2788-40ab-adfe-4607e237b65c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:28.266785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5a52a-2788-40ab-adfe-4607e237b65c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e6d5a52a-2788-40ab-adfe-4607e237b65c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:22:28.281244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:28.282401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:28.283397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:22:28.283397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:22:28.283397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:22:28.283397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:22:28.283397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:22:28.283397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:22:28.283397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:28.283397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:28.283397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 620/1244] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:22:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:28.288968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565402e-cf75-40df-b7ef-889f9d946513 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:28.426475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565402e-cf75-40df-b7ef-889f9d946513 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:28.471508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad95f4-3e42-4a1c-a92e-c78d01f5017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:28.472384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad95f4-3e42-4a1c-a92e-c78d01f5017f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:28.472783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad95f4-3e42-4a1c-a92e-c78d01f5017f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:28.473171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad95f4-3e42-4a1c-a92e-c78d01f5017f None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:28.474070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad95f4-3e42-4a1c-a92e-c78d01f5017f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:28.474554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad95f4-3e42-4a1c-a92e-c78d01f5017f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:28.476245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad95f4-3e42-4a1c-a92e-c78d01f5017f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:28.491031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 625/1245] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:22:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:28.498361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a52a-2788-40ab-adfe-4607e237b65c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:28.639763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5a52a-2788-40ab-adfe-4607e237b65c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:28.680779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe7f8e-d418-4cd8-a7b5-6c7f2e4f1d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:28.681368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe7f8e-d418-4cd8-a7b5-6c7f2e4f1d10 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:28.681639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe7f8e-d418-4cd8-a7b5-6c7f2e4f1d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:28.681908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe7f8e-d418-4cd8-a7b5-6c7f2e4f1d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:28.682645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe7f8e-d418-4cd8-a7b5-6c7f2e4f1d10 None admin] RBAC: Adding query filter params (role.id=392e59acab294916b7e3713134f2a626, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=496b8b8fa8ad4cc59b7f3d2c48cdd977) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:28.682979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe7f8e-d418-4cd8-a7b5-6c7f2e4f1d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:28.684405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe7f8e-d418-4cd8-a7b5-6c7f2e4f1d10 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:28.691724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 621/1246] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:22:28 2022] GET /identity/v3/role_assignments?user.id=496b8b8fa8ad4cc59b7f3d2c48cdd977&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=392e59acab294916b7e3713134f2a626 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:30.972545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77be245-7ec6-4d5d-800e-ba2647465838 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:30.973197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77be245-7ec6-4d5d-800e-ba2647465838 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:30.973197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77be245-7ec6-4d5d-800e-ba2647465838 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:30.974851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 626/1247] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:30.980968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc043-c209-4daf-90a6-db039bcff06b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:30.981419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc043-c209-4daf-90a6-db039bcff06b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:30.981592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc043-c209-4daf-90a6-db039bcff06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:30.989029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:31.004111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-236fc043-c209-4daf-90a6-db039bcff06b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:31.005555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-236fc043-c209-4daf-90a6-db039bcff06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:31.102804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 622/1248] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:22:31.412094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77be245-7ec6-4d5d-800e-ba2647465838 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:31.437555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:31.543998 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77be245-7ec6-4d5d-800e-ba2647465838 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:31.591315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33690f2-2750-43d9-947b-e8bb98389f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:31.592000 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33690f2-2750-43d9-947b-e8bb98389f31 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:31.592270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33690f2-2750-43d9-947b-e8bb98389f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:31.592562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33690f2-2750-43d9-947b-e8bb98389f31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:31.607290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33690f2-2750-43d9-947b-e8bb98389f31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c33690f2-2750-43d9-947b-e8bb98389f31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:22:31.612455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:31.613624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:31.614675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 627/1249] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:22:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:31.621124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fc043-c209-4daf-90a6-db039bcff06b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:31.746136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fc043-c209-4daf-90a6-db039bcff06b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:31.782395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:31.788276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33ec45-7e9b-4f8f-9d2c-3c9eb4afa40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:31.789223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33ec45-7e9b-4f8f-9d2c-3c9eb4afa40f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:31.789647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33ec45-7e9b-4f8f-9d2c-3c9eb4afa40f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:31.790126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33ec45-7e9b-4f8f-9d2c-3c9eb4afa40f None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:31.790979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33ec45-7e9b-4f8f-9d2c-3c9eb4afa40f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:31.791455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33ec45-7e9b-4f8f-9d2c-3c9eb4afa40f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:31.793019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33ec45-7e9b-4f8f-9d2c-3c9eb4afa40f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:31.803225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 623/1250] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:22:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:31.810012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33690f2-2750-43d9-947b-e8bb98389f31 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:31.900150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:31.926743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33690f2-2750-43d9-947b-e8bb98389f31 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:31.966895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed5c95-2ef9-4bb7-86af-28e6be751d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:31.967878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5c95-2ef9-4bb7-86af-28e6be751d06 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:31.968297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5c95-2ef9-4bb7-86af-28e6be751d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:31.968677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5c95-2ef9-4bb7-86af-28e6be751d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:31.981584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed5c95-2ef9-4bb7-86af-28e6be751d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:31.983147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed5c95-2ef9-4bb7-86af-28e6be751d06 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-33ed5c95-2ef9-4bb7-86af-28e6be751d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:32.000582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:32.001614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:32.002535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:32.002535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:32.002535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:32.002535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 628/1251] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:32.007973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33ec45-7e9b-4f8f-9d2c-3c9eb4afa40f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:32.134962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33ec45-7e9b-4f8f-9d2c-3c9eb4afa40f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:32.180483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5458-f90a-4e99-b87d-d340ee39b3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:32.181488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5458-f90a-4e99-b87d-d340ee39b3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:32.182066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5458-f90a-4e99-b87d-d340ee39b3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:32.182440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5458-f90a-4e99-b87d-d340ee39b3f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:32.185694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e5458-f90a-4e99-b87d-d340ee39b3f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:32.186230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e5458-f90a-4e99-b87d-d340ee39b3f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:32.188320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e5458-f90a-4e99-b87d-d340ee39b3f6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:32.214843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 624/1252] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:32.216992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed5c95-2ef9-4bb7-86af-28e6be751d06 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:32.345279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed5c95-2ef9-4bb7-86af-28e6be751d06 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:32.378134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:32.390406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac92645-a5f7-4b15-8c80-efad4cc9bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:32.391077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac92645-a5f7-4b15-8c80-efad4cc9bd25 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:32.391366 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac92645-a5f7-4b15-8c80-efad4cc9bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:32.391634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac92645-a5f7-4b15-8c80-efad4cc9bd25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:32.402063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac92645-a5f7-4b15-8c80-efad4cc9bd25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:32.403713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac92645-a5f7-4b15-8c80-efad4cc9bd25 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1ac92645-a5f7-4b15-8c80-efad4cc9bd25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:22:32.418041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:32.419331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:32.420471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 629/1253] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:32.425897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5458-f90a-4e99-b87d-d340ee39b3f6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:32.505966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:32.568301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5458-f90a-4e99-b87d-d340ee39b3f6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:32.620474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f5fef-908a-43ef-bbd0-8116c40f4406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:32.621216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f5fef-908a-43ef-bbd0-8116c40f4406 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:32.621596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f5fef-908a-43ef-bbd0-8116c40f4406 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:32.621864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f5fef-908a-43ef-bbd0-8116c40f4406 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:32.622610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f5fef-908a-43ef-bbd0-8116c40f4406 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:32.623060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f5fef-908a-43ef-bbd0-8116c40f4406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:32.625699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f5fef-908a-43ef-bbd0-8116c40f4406 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:32.648548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 625/1254] 10.222.0.78 () {56 vars in 1143 bytes} [Wed Aug 24 03:22:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:32.654561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac92645-a5f7-4b15-8c80-efad4cc9bd25 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:32.770245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac92645-a5f7-4b15-8c80-efad4cc9bd25 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:32.810012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30e3bc-cf7a-4561-ad79-c0e30a317ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:32.810720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30e3bc-cf7a-4561-ad79-c0e30a317ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:32.811107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30e3bc-cf7a-4561-ad79-c0e30a317ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:32.811444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30e3bc-cf7a-4561-ad79-c0e30a317ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:32.874725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:32.888632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30e3bc-cf7a-4561-ad79-c0e30a317ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:32.890938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30e3bc-cf7a-4561-ad79-c0e30a317ae2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:33.015623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 630/1255] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:22:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:22:33.022147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f5fef-908a-43ef-bbd0-8116c40f4406 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:33.157952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f5fef-908a-43ef-bbd0-8116c40f4406 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:33.171460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:33.196411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a70ec9-2fe4-486b-91a0-448478e37cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:33.197055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a70ec9-2fe4-486b-91a0-448478e37cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:33.197328 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a70ec9-2fe4-486b-91a0-448478e37cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:33.197591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a70ec9-2fe4-486b-91a0-448478e37cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:33.210389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a70ec9-2fe4-486b-91a0-448478e37cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:33.212058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a70ec9-2fe4-486b-91a0-448478e37cc9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-59a70ec9-2fe4-486b-91a0-448478e37cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:33.228590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:33.229819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:33.230974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:33.230974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:33.230974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:33.235899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 626/1256] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:33.236936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30e3bc-cf7a-4561-ad79-c0e30a317ae2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:33.347343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:33.362149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30e3bc-cf7a-4561-ad79-c0e30a317ae2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:33.403568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d958e-61e7-4cc5-aba1-8f2682c7ba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:33.405004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d958e-61e7-4cc5-aba1-8f2682c7ba77 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:33.405126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d958e-61e7-4cc5-aba1-8f2682c7ba77 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:33.405483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d958e-61e7-4cc5-aba1-8f2682c7ba77 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:33.406216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d958e-61e7-4cc5-aba1-8f2682c7ba77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:33.406599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d958e-61e7-4cc5-aba1-8f2682c7ba77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:33.408639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d958e-61e7-4cc5-aba1-8f2682c7ba77 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:33.424037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 631/1257] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:33.430146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a70ec9-2fe4-486b-91a0-448478e37cc9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:33.553821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a70ec9-2fe4-486b-91a0-448478e37cc9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:33.599544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d1a10-a63a-47a4-9448-baebcef1b331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:33.600202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1a10-a63a-47a4-9448-baebcef1b331 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:33.600474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1a10-a63a-47a4-9448-baebcef1b331 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:33.600751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1a10-a63a-47a4-9448-baebcef1b331 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:33.608928 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d1a10-a63a-47a4-9448-baebcef1b331 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:33.610452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d1a10-a63a-47a4-9448-baebcef1b331 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-717d1a10-a63a-47a4-9448-baebcef1b331 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:22:33.623340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:33.624385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:33.625674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:22:33.625674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:22:33.625674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:22:33.625674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:22:33.625674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:22:33.625674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:22:33.625674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:33.625674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:33.625674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 627/1258] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:22:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:33.630511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d958e-61e7-4cc5-aba1-8f2682c7ba77 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:33.740490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d958e-61e7-4cc5-aba1-8f2682c7ba77 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:33.777718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6af4ad-bbdc-4cad-82f6-f46e65abe90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:33.778348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af4ad-bbdc-4cad-82f6-f46e65abe90d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:33.778607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af4ad-bbdc-4cad-82f6-f46e65abe90d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:33.778896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af4ad-bbdc-4cad-82f6-f46e65abe90d None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:33.779945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6af4ad-bbdc-4cad-82f6-f46e65abe90d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:33.779945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6af4ad-bbdc-4cad-82f6-f46e65abe90d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:33.781374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6af4ad-bbdc-4cad-82f6-f46e65abe90d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:33.797369 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 632/1259] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:22:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:33.801952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d1a10-a63a-47a4-9448-baebcef1b331 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:33.831023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:33.918885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d1a10-a63a-47a4-9448-baebcef1b331 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:33.958812 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17e9bb-559e-4809-82ef-c5d22f50e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:33.959426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e9bb-559e-4809-82ef-c5d22f50e942 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:33.959792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e9bb-559e-4809-82ef-c5d22f50e942 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:33.959955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e9bb-559e-4809-82ef-c5d22f50e942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:33.960761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17e9bb-559e-4809-82ef-c5d22f50e942 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=496b8b8fa8ad4cc59b7f3d2c48cdd977) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:33.961000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17e9bb-559e-4809-82ef-c5d22f50e942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:33.962440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17e9bb-559e-4809-82ef-c5d22f50e942 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:33.968422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 628/1260] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:22:33 2022] GET /identity/v3/role_assignments?user.id=496b8b8fa8ad4cc59b7f3d2c48cdd977&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:35.913376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26ab93-ed44-4a27-a40f-66d86897383d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:35.913927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26ab93-ed44-4a27-a40f-66d86897383d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:35.913927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26ab93-ed44-4a27-a40f-66d86897383d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:35.915310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 633/1261] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:35.920980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5da50-db06-4328-896d-32c2f34e80a3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:35.921442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5da50-db06-4328-896d-32c2f34e80a3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:35.921532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5da50-db06-4328-896d-32c2f34e80a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:35.940312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5cf5da50-db06-4328-896d-32c2f34e80a3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:35.941550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5cf5da50-db06-4328-896d-32c2f34e80a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:36.012633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 629/1262] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:22:36.276640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26ab93-ed44-4a27-a40f-66d86897383d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:36.288369 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:36.384118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26ab93-ed44-4a27-a40f-66d86897383d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:36.419440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bf033-f030-40df-b66a-c1b61e4434d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:36.420111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bf033-f030-40df-b66a-c1b61e4434d2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:36.420384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bf033-f030-40df-b66a-c1b61e4434d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:36.420651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bf033-f030-40df-b66a-c1b61e4434d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:36.431383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bf033-f030-40df-b66a-c1b61e4434d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-541bf033-f030-40df-b66a-c1b61e4434d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:22:36.436059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:36.437123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:36.438049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 634/1263] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:22:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:36.443504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5da50-db06-4328-896d-32c2f34e80a3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:36.465586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:36.551290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5da50-db06-4328-896d-32c2f34e80a3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:36.585818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb678-8898-4fa7-87fe-4bfd0e6543d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:36.586426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb678-8898-4fa7-87fe-4bfd0e6543d8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:36.586700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb678-8898-4fa7-87fe-4bfd0e6543d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:36.586993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb678-8898-4fa7-87fe-4bfd0e6543d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:36.587664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eb678-8898-4fa7-87fe-4bfd0e6543d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:36.587962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eb678-8898-4fa7-87fe-4bfd0e6543d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:36.589335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eb678-8898-4fa7-87fe-4bfd0e6543d8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:36.598458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 630/1264] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:36.604458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bf033-f030-40df-b66a-c1b61e4434d2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:36.677135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:36.713646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bf033-f030-40df-b66a-c1b61e4434d2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:36.753574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278aebff-54a7-4d94-ae60-f21d164da8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:36.754227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278aebff-54a7-4d94-ae60-f21d164da8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:36.754499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278aebff-54a7-4d94-ae60-f21d164da8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:36.754798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278aebff-54a7-4d94-ae60-f21d164da8d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:36.767048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278aebff-54a7-4d94-ae60-f21d164da8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:36.768516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278aebff-54a7-4d94-ae60-f21d164da8d4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-278aebff-54a7-4d94-ae60-f21d164da8d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:36.784267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:36.785368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:36.791144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:36.791144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:36.791144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:36.791144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 635/1265] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:36.791667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb678-8898-4fa7-87fe-4bfd0e6543d8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:36.878986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:36.899787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb678-8898-4fa7-87fe-4bfd0e6543d8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:36.935742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855a651-05e0-46a6-8252-5d4ee28b080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:36.936385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855a651-05e0-46a6-8252-5d4ee28b080a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:36.936605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855a651-05e0-46a6-8252-5d4ee28b080a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:36.936874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855a651-05e0-46a6-8252-5d4ee28b080a None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:36.937525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855a651-05e0-46a6-8252-5d4ee28b080a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:36.937825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855a651-05e0-46a6-8252-5d4ee28b080a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:36.939204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855a651-05e0-46a6-8252-5d4ee28b080a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:36.951760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 631/1266] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:36.957724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278aebff-54a7-4d94-ae60-f21d164da8d4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:37.077335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278aebff-54a7-4d94-ae60-f21d164da8d4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:37.098643 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:37.124006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd19269-d4e0-4392-a87c-12ba9a00ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:37.124685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd19269-d4e0-4392-a87c-12ba9a00ab45 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:37.124965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd19269-d4e0-4392-a87c-12ba9a00ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:37.125235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd19269-d4e0-4392-a87c-12ba9a00ab45 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:37.133855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd19269-d4e0-4392-a87c-12ba9a00ab45 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:37.135311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd19269-d4e0-4392-a87c-12ba9a00ab45 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3cd19269-d4e0-4392-a87c-12ba9a00ab45 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:22:37.147211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:37.149048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:37.150972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 636/1267] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:37.155034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855a651-05e0-46a6-8252-5d4ee28b080a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:37.267244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855a651-05e0-46a6-8252-5d4ee28b080a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:37.303846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9781f1c-164d-482d-80ec-6cf806ea3deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:37.304451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9781f1c-164d-482d-80ec-6cf806ea3deb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:37.304725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9781f1c-164d-482d-80ec-6cf806ea3deb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:37.304987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9781f1c-164d-482d-80ec-6cf806ea3deb None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:37.305719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9781f1c-164d-482d-80ec-6cf806ea3deb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:37.306025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9781f1c-164d-482d-80ec-6cf806ea3deb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:37.307475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9781f1c-164d-482d-80ec-6cf806ea3deb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:37.316880 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:37.327241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 632/1268] 10.222.0.78 () {56 vars in 1143 bytes} [Wed Aug 24 03:22:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:37.333133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd19269-d4e0-4392-a87c-12ba9a00ab45 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:37.438250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd19269-d4e0-4392-a87c-12ba9a00ab45 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:37.473861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2a73c-7488-4d37-a4e2-d7d7e436bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:37.474489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2a73c-7488-4d37-a4e2-d7d7e436bf1b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:37.474791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2a73c-7488-4d37-a4e2-d7d7e436bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:37.475060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2a73c-7488-4d37-a4e2-d7d7e436bf1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:37.486005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2a73c-7488-4d37-a4e2-d7d7e436bf1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:37.487485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2a73c-7488-4d37-a4e2-d7d7e436bf1b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-93d2a73c-7488-4d37-a4e2-d7d7e436bf1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:37.504046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:37.505205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:37.506506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:37.506506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:37.506506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:37.506506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 637/1269] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:37.511492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9781f1c-164d-482d-80ec-6cf806ea3deb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:37.622120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9781f1c-164d-482d-80ec-6cf806ea3deb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:37.660430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694899d-39c3-41c6-a8bd-7a6329ea837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:37.661036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694899d-39c3-41c6-a8bd-7a6329ea837f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:37.661312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694899d-39c3-41c6-a8bd-7a6329ea837f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:37.661577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694899d-39c3-41c6-a8bd-7a6329ea837f None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:37.662222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694899d-39c3-41c6-a8bd-7a6329ea837f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:37.662528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694899d-39c3-41c6-a8bd-7a6329ea837f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:37.663920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694899d-39c3-41c6-a8bd-7a6329ea837f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:37.675971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 633/1270] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:37.682054 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2a73c-7488-4d37-a4e2-d7d7e436bf1b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:37.716071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:37.787300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2a73c-7488-4d37-a4e2-d7d7e436bf1b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:37.822396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e35c0-6d9b-4e58-a7f7-781c75e6443f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:37.823057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e35c0-6d9b-4e58-a7f7-781c75e6443f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:37.823331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e35c0-6d9b-4e58-a7f7-781c75e6443f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:37.823593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e35c0-6d9b-4e58-a7f7-781c75e6443f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:37.830759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e35c0-6d9b-4e58-a7f7-781c75e6443f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:37.832186 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e35c0-6d9b-4e58-a7f7-781c75e6443f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5e7e35c0-6d9b-4e58-a7f7-781c75e6443f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:22:37.844370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:37.845417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:37.846742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:22:37.846742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:22:37.846742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:22:37.846742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:22:37.846742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:22:37.846742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:22:37.846742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:37.846742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:37.846742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 638/1271] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:22:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:37.851522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694899d-39c3-41c6-a8bd-7a6329ea837f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:37.916831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:37.959481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694899d-39c3-41c6-a8bd-7a6329ea837f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:37.997930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ba5aa-d415-4f73-8f8a-310e8cc4512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:37.998535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ba5aa-d415-4f73-8f8a-310e8cc4512e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:37.998848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ba5aa-d415-4f73-8f8a-310e8cc4512e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:37.999110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ba5aa-d415-4f73-8f8a-310e8cc4512e None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:37.999808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ba5aa-d415-4f73-8f8a-310e8cc4512e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:38.000104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ba5aa-d415-4f73-8f8a-310e8cc4512e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:38.001528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ba5aa-d415-4f73-8f8a-310e8cc4512e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:38.014170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 634/1272] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:22:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:38.021262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e35c0-6d9b-4e58-a7f7-781c75e6443f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:38.145674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:38.155974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e35c0-6d9b-4e58-a7f7-781c75e6443f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:38.192471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b499674-9631-4c0b-968a-316d79192ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:38.193129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b499674-9631-4c0b-968a-316d79192ab5 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:38.193402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b499674-9631-4c0b-968a-316d79192ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:38.193665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b499674-9631-4c0b-968a-316d79192ab5 None admin] PATH_INFO: `/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/496b8b8fa8ad4cc59b7f3d2c48cdd977/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:38.195584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b499674-9631-4c0b-968a-316d79192ab5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0093840f59cc4070b3dead79b27c25bc, user_id=496b8b8fa8ad4cc59b7f3d2c48cdd977, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:38.197374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b499674-9631-4c0b-968a-316d79192ab5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:38.211434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 639/1273] 10.222.0.78 () {58 vars in 1439 bytes} [Wed Aug 24 03:22:38 2022] PUT /identity/v3/projects/0093840f59cc4070b3dead79b27c25bc/users/496b8b8fa8ad4cc59b7f3d2c48cdd977/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:22:40.120644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82f0a3-1743-4e7e-b5a1-93db7e55ec0f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:40.121362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82f0a3-1743-4e7e-b5a1-93db7e55ec0f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:40.121362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82f0a3-1743-4e7e-b5a1-93db7e55ec0f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:40.122501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 635/1274] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:40.128216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24c8b9-5551-4418-acd8-e3f6d381c07d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:40.128678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24c8b9-5551-4418-acd8-e3f6d381c07d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:40.128770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24c8b9-5551-4418-acd8-e3f6d381c07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:40.148258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fa24c8b9-5551-4418-acd8-e3f6d381c07d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:40.149470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fa24c8b9-5551-4418-acd8-e3f6d381c07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:40.223024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 640/1275] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:22:40.490061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82f0a3-1743-4e7e-b5a1-93db7e55ec0f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:40.605985 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82f0a3-1743-4e7e-b5a1-93db7e55ec0f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:40.624700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:40.645394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b868d9-5d59-4d1e-ae93-3c84b42b10dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:40.646028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b868d9-5d59-4d1e-ae93-3c84b42b10dc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:40.646287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b868d9-5d59-4d1e-ae93-3c84b42b10dc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:40.646551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b868d9-5d59-4d1e-ae93-3c84b42b10dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:40.657318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b868d9-5d59-4d1e-ae93-3c84b42b10dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-83b868d9-5d59-4d1e-ae93-3c84b42b10dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:22:40.662529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:40.663666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:40.664554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 636/1276] 10.222.0.78 () {56 vars in 1096 bytes} [Wed Aug 24 03:22:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:22:40.670251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24c8b9-5551-4418-acd8-e3f6d381c07d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:40.756235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:40.777733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24c8b9-5551-4418-acd8-e3f6d381c07d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:40.814388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce403-5674-4319-89fc-6202ebbcf0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:40.815037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce403-5674-4319-89fc-6202ebbcf0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:40.815312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce403-5674-4319-89fc-6202ebbcf0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:40.815584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce403-5674-4319-89fc-6202ebbcf0d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:40.816255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce403-5674-4319-89fc-6202ebbcf0d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:40.816556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce403-5674-4319-89fc-6202ebbcf0d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:40.817948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce403-5674-4319-89fc-6202ebbcf0d5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:40.828787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 641/1277] 10.222.0.78 () {56 vars in 1099 bytes} [Wed Aug 24 03:22:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:40.834822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b868d9-5d59-4d1e-ae93-3c84b42b10dc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:40.950584 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b868d9-5d59-4d1e-ae93-3c84b42b10dc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:40.993488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25278e59-13df-4fb1-b5e5-f7cf7bafed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:40.994140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25278e59-13df-4fb1-b5e5-f7cf7bafed55 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:40.994416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25278e59-13df-4fb1-b5e5-f7cf7bafed55 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:40.994707 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25278e59-13df-4fb1-b5e5-f7cf7bafed55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:41.008444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25278e59-13df-4fb1-b5e5-f7cf7bafed55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:41.009876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25278e59-13df-4fb1-b5e5-f7cf7bafed55 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-25278e59-13df-4fb1-b5e5-f7cf7bafed55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:41.027596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:41.029726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:41.031040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:41.031040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:41.031040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:41.031040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 637/1278] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:41.035883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce403-5674-4319-89fc-6202ebbcf0d5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:41.172636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce403-5674-4319-89fc-6202ebbcf0d5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:41.213352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfece3-3584-407d-aeca-40bb36e4993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:41.213986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfece3-3584-407d-aeca-40bb36e4993f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:41.214250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfece3-3584-407d-aeca-40bb36e4993f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:41.214519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfece3-3584-407d-aeca-40bb36e4993f None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:41.215244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfece3-3584-407d-aeca-40bb36e4993f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:41.215546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfece3-3584-407d-aeca-40bb36e4993f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:41.217169 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfece3-3584-407d-aeca-40bb36e4993f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:41.231690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 642/1279] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:41.237887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25278e59-13df-4fb1-b5e5-f7cf7bafed55 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:41.272716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:41.343973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25278e59-13df-4fb1-b5e5-f7cf7bafed55 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:41.381456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e2a79-769e-4d17-837b-bbc7ea5a4448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:41.382081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2a79-769e-4d17-837b-bbc7ea5a4448 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:41.382348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2a79-769e-4d17-837b-bbc7ea5a4448 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:41.382610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2a79-769e-4d17-837b-bbc7ea5a4448 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:41.390891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e2a79-769e-4d17-837b-bbc7ea5a4448 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:41.392400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e2a79-769e-4d17-837b-bbc7ea5a4448 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-975e2a79-769e-4d17-837b-bbc7ea5a4448 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:22:41.404320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:41.405507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:41.411429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 638/1280] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:41.412149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfece3-3584-407d-aeca-40bb36e4993f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:41.415706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:41.525521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfece3-3584-407d-aeca-40bb36e4993f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:41.567844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c6ff6-6762-494c-8c5b-fb601ee5ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:41.568730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c6ff6-6762-494c-8c5b-fb601ee5ad3c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:41.569140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c6ff6-6762-494c-8c5b-fb601ee5ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:41.569577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c6ff6-6762-494c-8c5b-fb601ee5ad3c None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:41.571183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c6ff6-6762-494c-8c5b-fb601ee5ad3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:41.571694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c6ff6-6762-494c-8c5b-fb601ee5ad3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:41.574002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c6ff6-6762-494c-8c5b-fb601ee5ad3c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:41.597296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 643/1281] 10.222.0.78 () {56 vars in 1143 bytes} [Wed Aug 24 03:22:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:41.603420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e2a79-769e-4d17-837b-bbc7ea5a4448 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:41.725988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:41.736474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e2a79-769e-4d17-837b-bbc7ea5a4448 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:41.772062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04ea04-1667-4d5b-9d0e-b8ca31a26440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:41.772673 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04ea04-1667-4d5b-9d0e-b8ca31a26440 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:41.772930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04ea04-1667-4d5b-9d0e-b8ca31a26440 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:41.773199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04ea04-1667-4d5b-9d0e-b8ca31a26440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:41.843741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04ea04-1667-4d5b-9d0e-b8ca31a26440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:41.845108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04ea04-1667-4d5b-9d0e-b8ca31a26440 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:41.940809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:41.953560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 639/1282] 10.222.0.78 () {58 vars in 1282 bytes} [Wed Aug 24 03:22:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:22:41.959666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c6ff6-6762-494c-8c5b-fb601ee5ad3c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:42.025005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:42.078255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c6ff6-6762-494c-8c5b-fb601ee5ad3c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:42.115144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323e45a-447d-40a0-8153-936ffb9cff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:42.115686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323e45a-447d-40a0-8153-936ffb9cff4d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:42.115956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323e45a-447d-40a0-8153-936ffb9cff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:42.116220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323e45a-447d-40a0-8153-936ffb9cff4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:42.126689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323e45a-447d-40a0-8153-936ffb9cff4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:42.128143 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323e45a-447d-40a0-8153-936ffb9cff4d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-4323e45a-447d-40a0-8153-936ffb9cff4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:22:42.142839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:42.143979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:22:42.145227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:22:42.145227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:22:42.145227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:42.145227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 644/1283] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:42.149928 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04ea04-1667-4d5b-9d0e-b8ca31a26440 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:42.265961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04ea04-1667-4d5b-9d0e-b8ca31a26440 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:42.303236 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca3c84-6309-4db3-95bb-759815c2d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:42.303834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3c84-6309-4db3-95bb-759815c2d9ff None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:42.304107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3c84-6309-4db3-95bb-759815c2d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:42.304352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3c84-6309-4db3-95bb-759815c2d9ff None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:42.304998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca3c84-6309-4db3-95bb-759815c2d9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:42.305296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca3c84-6309-4db3-95bb-759815c2d9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:42.306687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca3c84-6309-4db3-95bb-759815c2d9ff None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:42.318543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 640/1284] 10.222.0.78 () {56 vars in 1109 bytes} [Wed Aug 24 03:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:42.324893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323e45a-447d-40a0-8153-936ffb9cff4d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:42.429322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323e45a-447d-40a0-8153-936ffb9cff4d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:42.444773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:42.467349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66476aa7-a3ad-4593-98b0-cb0dd37d5060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:42.467982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66476aa7-a3ad-4593-98b0-cb0dd37d5060 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:42.468252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66476aa7-a3ad-4593-98b0-cb0dd37d5060 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:42.468515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66476aa7-a3ad-4593-98b0-cb0dd37d5060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:42.475413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66476aa7-a3ad-4593-98b0-cb0dd37d5060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:42.476858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66476aa7-a3ad-4593-98b0-cb0dd37d5060 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-66476aa7-a3ad-4593-98b0-cb0dd37d5060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:22:42.488394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:42.489415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:42.490645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:22:42.490645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:22:42.490645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:22:42.490645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:22:42.490645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:22:42.490645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:22:42.490645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:22:42.490645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 03:22:42.490645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 645/1285] 10.222.0.78 () {56 vars in 1111 bytes} [Wed Aug 24 03:22:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:42.495600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca3c84-6309-4db3-95bb-759815c2d9ff None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:42.555005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:42.613353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca3c84-6309-4db3-95bb-759815c2d9ff None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:42.653471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49257309-823a-4b82-8474-c0c8d707e995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:42.654404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49257309-823a-4b82-8474-c0c8d707e995 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:42.654696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49257309-823a-4b82-8474-c0c8d707e995 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:42.654964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49257309-823a-4b82-8474-c0c8d707e995 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:42.655659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49257309-823a-4b82-8474-c0c8d707e995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:42.655957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49257309-823a-4b82-8474-c0c8d707e995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:42.657399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49257309-823a-4b82-8474-c0c8d707e995 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:42.671199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 641/1286] 10.222.0.78 () {56 vars in 1148 bytes} [Wed Aug 24 03:22:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:42.677595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66476aa7-a3ad-4593-98b0-cb0dd37d5060 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:42.783930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66476aa7-a3ad-4593-98b0-cb0dd37d5060 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:42.820012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef889a4b-a3f3-4785-a12d-435f677227f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:42.820608 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef889a4b-a3f3-4785-a12d-435f677227f6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:42.821215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef889a4b-a3f3-4785-a12d-435f677227f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:42.821513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef889a4b-a3f3-4785-a12d-435f677227f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:42.822191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef889a4b-a3f3-4785-a12d-435f677227f6 None admin] RBAC: Adding query filter params (role.id=e2245cc9e9804bbf8942f7864a05d2e2, scope.project.id=0093840f59cc4070b3dead79b27c25bc, user.id=496b8b8fa8ad4cc59b7f3d2c48cdd977) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:42.822521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef889a4b-a3f3-4785-a12d-435f677227f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:42.823980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef889a4b-a3f3-4785-a12d-435f677227f6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:42.829918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 646/1287] 10.222.0.78 () {56 vars in 1374 bytes} [Wed Aug 24 03:22:42 2022] GET /identity/v3/role_assignments?user.id=496b8b8fa8ad4cc59b7f3d2c48cdd977&scope.project.id=0093840f59cc4070b3dead79b27c25bc&role.id=e2245cc9e9804bbf8942f7864a05d2e2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:44.800629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1d1ae-b72b-4405-b647-eaf930c65347 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:44.801226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1d1ae-b72b-4405-b647-eaf930c65347 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:44.801226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1d1ae-b72b-4405-b647-eaf930c65347 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:44.802540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 642/1288] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:44.808208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc0ba6-51b9-4480-94a3-036b19b0c9f6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:44.808656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc0ba6-51b9-4480-94a3-036b19b0c9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:44.808769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc0ba6-51b9-4480-94a3-036b19b0c9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:44.828456 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d1dc0ba6-51b9-4480-94a3-036b19b0c9f6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:44.829665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d1dc0ba6-51b9-4480-94a3-036b19b0c9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:44.862516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:44.903786 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 647/1289] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:22:45.171331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1d1ae-b72b-4405-b647-eaf930c65347 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:45.279407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1d1ae-b72b-4405-b647-eaf930c65347 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:45.290534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:45.321595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a221e1-bcac-469b-87d7-e8643a79dcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:45.322227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a221e1-bcac-469b-87d7-e8643a79dcbd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:45.322486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a221e1-bcac-469b-87d7-e8643a79dcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:45.322792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a221e1-bcac-469b-87d7-e8643a79dcbd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:45.323389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a221e1-bcac-469b-87d7-e8643a79dcbd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:45.324764 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a221e1-bcac-469b-87d7-e8643a79dcbd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-02a221e1-bcac-469b-87d7-e8643a79dcbd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:45.334544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:45.335619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:45.336553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 643/1290] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:22:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:45.342328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc0ba6-51b9-4480-94a3-036b19b0c9f6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:45.451451 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc0ba6-51b9-4480-94a3-036b19b0c9f6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:45.487576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47044fc-e30a-48ea-8455-b6c03eafdfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:45.488316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47044fc-e30a-48ea-8455-b6c03eafdfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:45.488597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47044fc-e30a-48ea-8455-b6c03eafdfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:45.488871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47044fc-e30a-48ea-8455-b6c03eafdfa7 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:45.489505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47044fc-e30a-48ea-8455-b6c03eafdfa7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:45.489805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47044fc-e30a-48ea-8455-b6c03eafdfa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:45.491219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47044fc-e30a-48ea-8455-b6c03eafdfa7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:45.496223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 648/1291] 10.222.0.78 () {56 vars in 1116 bytes} [Wed Aug 24 03:22:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:45.503097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a221e1-bcac-469b-87d7-e8643a79dcbd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:45.622524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a221e1-bcac-469b-87d7-e8643a79dcbd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:45.663982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0ba9b-52a6-4627-9252-ba28a38b9196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:45.664587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0ba9b-52a6-4627-9252-ba28a38b9196 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:45.664950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0ba9b-52a6-4627-9252-ba28a38b9196 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:45.665221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0ba9b-52a6-4627-9252-ba28a38b9196 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:45.666852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0ba9b-52a6-4627-9252-ba28a38b9196 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:45.667155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0ba9b-52a6-4627-9252-ba28a38b9196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:45.668524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0ba9b-52a6-4627-9252-ba28a38b9196 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:45.676516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 644/1292] 10.222.0.78 () {56 vars in 1116 bytes} [Wed Aug 24 03:22:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:47.573467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83752c88-35fb-449d-b4e1-13a466a1bda4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:47.574129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83752c88-35fb-449d-b4e1-13a466a1bda4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:47.574129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83752c88-35fb-449d-b4e1-13a466a1bda4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:47.575429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 649/1293] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:47.582715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb34df-e064-47d8-a8ba-86abc2fc7515 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:47.583380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb34df-e064-47d8-a8ba-86abc2fc7515 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:47.583380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb34df-e064-47d8-a8ba-86abc2fc7515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:47.604593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e0bb34df-e064-47d8-a8ba-86abc2fc7515 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:47.605933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e0bb34df-e064-47d8-a8ba-86abc2fc7515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:47.642644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:47.689001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 645/1294] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:22:47.968979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83752c88-35fb-449d-b4e1-13a466a1bda4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:48.003132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:48.092056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83752c88-35fb-449d-b4e1-13a466a1bda4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:48.136675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcf026-1379-43ea-8788-b7076ccb5482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:48.137389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcf026-1379-43ea-8788-b7076ccb5482 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:48.137665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcf026-1379-43ea-8788-b7076ccb5482 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:48.137929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcf026-1379-43ea-8788-b7076ccb5482 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:48.139121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcf026-1379-43ea-8788-b7076ccb5482 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:48.140154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcf026-1379-43ea-8788-b7076ccb5482 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:48.156548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 650/1295] 10.222.0.78 () {60 vars in 1141 bytes} [Wed Aug 24 03:22:47 2022] POST /identity/v3/services => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:22:50.106858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00484a2-fa2f-40bd-9590-db5060a0f9d3 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:50.107475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00484a2-fa2f-40bd-9590-db5060a0f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:50.107475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00484a2-fa2f-40bd-9590-db5060a0f9d3 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:50.108743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 646/1296] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:50.114463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe4f3c-fcb0-4d6f-a754-b3cbd0421656 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:50.114969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe4f3c-fcb0-4d6f-a754-b3cbd0421656 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:50.115071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe4f3c-fcb0-4d6f-a754-b3cbd0421656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:50.135682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-22fe4f3c-fcb0-4d6f-a754-b3cbd0421656 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:50.136916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-22fe4f3c-fcb0-4d6f-a754-b3cbd0421656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:50.218206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 651/1297] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:22:50.482195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00484a2-fa2f-40bd-9590-db5060a0f9d3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:50.604597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00484a2-fa2f-40bd-9590-db5060a0f9d3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:50.644282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a9535-d645-499a-830e-edaef34b8798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:50.644915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a9535-d645-499a-830e-edaef34b8798 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:50.645188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a9535-d645-499a-830e-edaef34b8798 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:50.645456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a9535-d645-499a-830e-edaef34b8798 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:50.646055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a9535-d645-499a-830e-edaef34b8798 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:50.647460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a9535-d645-499a-830e-edaef34b8798 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6c6a9535-d645-499a-830e-edaef34b8798 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:50.657100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:50.658751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:50.660450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 647/1298] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:22:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:50.664875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe4f3c-fcb0-4d6f-a754-b3cbd0421656 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:50.687415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:50.784694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe4f3c-fcb0-4d6f-a754-b3cbd0421656 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:50.821402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff12cb-9f0a-4585-84fb-cebc6e85fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:50.822012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff12cb-9f0a-4585-84fb-cebc6e85fe02 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:50.822287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff12cb-9f0a-4585-84fb-cebc6e85fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:50.822559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff12cb-9f0a-4585-84fb-cebc6e85fe02 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:50.823228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff12cb-9f0a-4585-84fb-cebc6e85fe02 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:50.823531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff12cb-9f0a-4585-84fb-cebc6e85fe02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:50.824912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff12cb-9f0a-4585-84fb-cebc6e85fe02 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:50.830401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 652/1299] 10.222.0.78 () {56 vars in 1116 bytes} [Wed Aug 24 03:22:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:50.836763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a9535-d645-499a-830e-edaef34b8798 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:50.874566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:50.949369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a9535-d645-499a-830e-edaef34b8798 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:50.983739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fab9aa-ed77-4f1f-baae-e0e32ca9a903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:50.984351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fab9aa-ed77-4f1f-baae-e0e32ca9a903 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:50.984631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fab9aa-ed77-4f1f-baae-e0e32ca9a903 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:50.984903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fab9aa-ed77-4f1f-baae-e0e32ca9a903 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:50.985635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fab9aa-ed77-4f1f-baae-e0e32ca9a903 None admin] RBAC: Adding query filter params (interface=public, service_id=dc7b2c38380544d2b492d62614a6ed9b, region_id=RegionOne) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:50.985921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fab9aa-ed77-4f1f-baae-e0e32ca9a903 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:50.987322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fab9aa-ed77-4f1f-baae-e0e32ca9a903 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:50.992630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 648/1300] 10.222.0.78 () {56 vars in 1251 bytes} [Wed Aug 24 03:22:50 2022] GET /identity/v3/endpoints?service_id=dc7b2c38380544d2b492d62614a6ed9b&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:50.999387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff12cb-9f0a-4585-84fb-cebc6e85fe02 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:51.106277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:51.126948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff12cb-9f0a-4585-84fb-cebc6e85fe02 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:51.163734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba3c31-568d-4aad-b239-613f058e87c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:51.164319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3c31-568d-4aad-b239-613f058e87c8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:51.164622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3c31-568d-4aad-b239-613f058e87c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:51.164890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3c31-568d-4aad-b239-613f058e87c8 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:51.165497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba3c31-568d-4aad-b239-613f058e87c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:51.166908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba3c31-568d-4aad-b239-613f058e87c8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:51.174218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 653/1301] 10.222.0.78 () {56 vars in 1087 bytes} [Wed Aug 24 03:22:50 2022] GET /identity/v3/services => generated 2191 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:22:53.080625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9376372-962a-4578-8772-b56915bbe0e7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:53.081215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9376372-962a-4578-8772-b56915bbe0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:53.081500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9376372-962a-4578-8772-b56915bbe0e7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:53.083415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 649/1302] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:22:53.089261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227bfa3-66f2-4b4a-aa98-f5ed9dafd1ef None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:53.089740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227bfa3-66f2-4b4a-aa98-f5ed9dafd1ef None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:53.089832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227bfa3-66f2-4b4a-aa98-f5ed9dafd1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:53.109398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d227bfa3-66f2-4b4a-aa98-f5ed9dafd1ef None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:22:53.110610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d227bfa3-66f2-4b4a-aa98-f5ed9dafd1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:22:53.183227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 654/1303] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:22:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:22:53.452618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9376372-962a-4578-8772-b56915bbe0e7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:53.562510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:53.571520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9376372-962a-4578-8772-b56915bbe0e7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:53.609087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b31479-671d-439b-a7bf-1f62f54ea8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:53.609761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b31479-671d-439b-a7bf-1f62f54ea8df None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:53.610039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b31479-671d-439b-a7bf-1f62f54ea8df None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:53.610307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b31479-671d-439b-a7bf-1f62f54ea8df None admin] PATH_INFO: `/v3/services/placement` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:53.610943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b31479-671d-439b-a7bf-1f62f54ea8df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:53.612342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b31479-671d-439b-a7bf-1f62f54ea8df None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-d7b31479-671d-439b-a7bf-1f62f54ea8df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:22:53.621503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:22:53.623201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 03:22:53.624565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 650/1304] 10.222.0.78 () {56 vars in 1117 bytes} [Wed Aug 24 03:22:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:22:53.629065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227bfa3-66f2-4b4a-aa98-f5ed9dafd1ef None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:53.715024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:53.740528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227bfa3-66f2-4b4a-aa98-f5ed9dafd1ef None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:53.778271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495c7c6-8e01-43d0-bb56-068cdb71be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:53.779176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495c7c6-8e01-43d0-bb56-068cdb71be59 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:53.779452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495c7c6-8e01-43d0-bb56-068cdb71be59 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:53.779717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495c7c6-8e01-43d0-bb56-068cdb71be59 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:53.780370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495c7c6-8e01-43d0-bb56-068cdb71be59 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:22:53.780859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495c7c6-8e01-43d0-bb56-068cdb71be59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:53.784851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495c7c6-8e01-43d0-bb56-068cdb71be59 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:53.790784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 655/1305] 10.222.0.78 () {56 vars in 1116 bytes} [Wed Aug 24 03:22:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:22:53.797438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b31479-671d-439b-a7bf-1f62f54ea8df None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:22:53.903995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b31479-671d-439b-a7bf-1f62f54ea8df None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:22:53.941694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fe7b5-5303-4975-95b0-ca1f49687df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:22:53.942297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fe7b5-5303-4975-95b0-ca1f49687df5 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:22:53.942566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fe7b5-5303-4975-95b0-ca1f49687df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:22:53.942862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fe7b5-5303-4975-95b0-ca1f49687df5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:22:53.943519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fe7b5-5303-4975-95b0-ca1f49687df5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:22:53.944877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fe7b5-5303-4975-95b0-ca1f49687df5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:22:53.966801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 651/1306] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:22:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:23:03.787376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=30 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:03.962159 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:59.769492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be398eb-c3b1-4446-ad6a-c5afc9956d80 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:23:59.769963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be398eb-c3b1-4446-ad6a-c5afc9956d80 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:23:59.769963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be398eb-c3b1-4446-ad6a-c5afc9956d80 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:23:59.771310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 656/1307] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:23:59.776854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc1bd-0e8f-4eea-83f7-39f33f6b0a89 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:23:59.777308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc1bd-0e8f-4eea-83f7-39f33f6b0a89 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:23:59.777455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc1bd-0e8f-4eea-83f7-39f33f6b0a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:23:59.885498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-539fc1bd-0e8f-4eea-83f7-39f33f6b0a89 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:23:59.887220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-539fc1bd-0e8f-4eea-83f7-39f33f6b0a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:00.019440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 652/1308] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:00.307882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170b84f-6036-427b-a4e0-e183dc557879 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:00.308134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170b84f-6036-427b-a4e0-e183dc557879 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:00.308651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170b84f-6036-427b-a4e0-e183dc557879 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:00.310241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 657/1309] 10.222.0.78 () {54 vars in 965 bytes} [Wed Aug 24 03:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:00.316821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be897b74-2659-497e-9c57-ce83a3168c5f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:00.317128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be897b74-2659-497e-9c57-ce83a3168c5f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:00.317404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be897b74-2659-497e-9c57-ce83a3168c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:00.409314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-be897b74-2659-497e-9c57-ce83a3168c5f None None] MFA Rules not processed for user `0e7bc56706f2491b92f5745a0fbc2acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:00.410495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-be897b74-2659-497e-9c57-ce83a3168c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:00.435812 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:00.514973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 653/1310] 10.222.0.78 () {58 vars in 1062 bytes} [Wed Aug 24 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:00.525170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170b84f-6036-427b-a4e0-e183dc557879 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:00.527127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4170b84f-6036-427b-a4e0-e183dc557879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:00.666600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170b84f-6036-427b-a4e0-e183dc557879 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:00.749485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7867d82-03c6-4343-9f10-4402a95911c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:00.750283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867d82-03c6-4343-9f10-4402a95911c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:00.750688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867d82-03c6-4343-9f10-4402a95911c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:00.751043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867d82-03c6-4343-9f10-4402a95911c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:00.752773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b7867d82-03c6-4343-9f10-4402a95911c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:00.813349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:00.874446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7867d82-03c6-4343-9f10-4402a95911c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:00.876108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7867d82-03c6-4343-9f10-4402a95911c3 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:00.896827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 658/1311] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:03.124246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bba7-d4c5-436e-9342-852d5f3cb2e9 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:03.124805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bba7-d4c5-436e-9342-852d5f3cb2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:03.124805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bba7-d4c5-436e-9342-852d5f3cb2e9 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:03.126122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 654/1312] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:03.131606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb955c-6858-470b-80a8-89209f3b8d5b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:03.132082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb955c-6858-470b-80a8-89209f3b8d5b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:03.132307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb955c-6858-470b-80a8-89209f3b8d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:03.229223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b5eb955c-6858-470b-80a8-89209f3b8d5b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:03.230893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b5eb955c-6858-470b-80a8-89209f3b8d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:03.356474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 659/1313] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:03.657032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07dd1b-d440-4a03-9e73-4a0b0b156d14 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:03.657288 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07dd1b-d440-4a03-9e73-4a0b0b156d14 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:03.657565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07dd1b-d440-4a03-9e73-4a0b0b156d14 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:03.658990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 655/1314] 10.222.0.78 () {54 vars in 965 bytes} [Wed Aug 24 03:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:03.665933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2193da4-bfbb-4b6f-ba2d-c662c3f87afa None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:03.666281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2193da4-bfbb-4b6f-ba2d-c662c3f87afa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:03.666623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2193da4-bfbb-4b6f-ba2d-c662c3f87afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:03.680772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:03.757663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c2193da4-bfbb-4b6f-ba2d-c662c3f87afa None None] MFA Rules not processed for user `0e7bc56706f2491b92f5745a0fbc2acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:03.758971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c2193da4-bfbb-4b6f-ba2d-c662c3f87afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:03.849667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 660/1315] 10.222.0.78 () {58 vars in 1062 bytes} [Wed Aug 24 03:24:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:03.859696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07dd1b-d440-4a03-9e73-4a0b0b156d14 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:03.861367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-af07dd1b-d440-4a03-9e73-4a0b0b156d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:03.991498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07dd1b-d440-4a03-9e73-4a0b0b156d14 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:04.071756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:04.075883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96b598-1b2e-4264-8405-c761d83e2114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:04.076492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96b598-1b2e-4264-8405-c761d83e2114 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:04.076765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96b598-1b2e-4264-8405-c761d83e2114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:04.077033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96b598-1b2e-4264-8405-c761d83e2114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:04.079124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9c96b598-1b2e-4264-8405-c761d83e2114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:04.200612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96b598-1b2e-4264-8405-c761d83e2114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:04.202093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96b598-1b2e-4264-8405-c761d83e2114 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:04.222222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 656/1316] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:06.761528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85223ad6-6130-41ed-b386-63f5f930cd07 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:06.762156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85223ad6-6130-41ed-b386-63f5f930cd07 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:06.762278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85223ad6-6130-41ed-b386-63f5f930cd07 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:06.763648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 661/1317] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:06.769434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb729e7-e241-42f9-8dc8-d4854791f64a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:06.769938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb729e7-e241-42f9-8dc8-d4854791f64a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:06.770035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb729e7-e241-42f9-8dc8-d4854791f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:06.843836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0fb729e7-e241-42f9-8dc8-d4854791f64a None None] MFA Rules not processed for user `b81582df34a44b238abda1fb4c41a74a`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:06.845153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0fb729e7-e241-42f9-8dc8-d4854791f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:06.906308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:06.959416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 657/1318] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:07.246427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85223ad6-6130-41ed-b386-63f5f930cd07 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:07.248876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-85223ad6-6130-41ed-b386-63f5f930cd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:07.360923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85223ad6-6130-41ed-b386-63f5f930cd07 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:07.363806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:07.445578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16dd6-0e72-4f32-aa4b-44f65691ecb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:07.446188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16dd6-0e72-4f32-aa4b-44f65691ecb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:07.446447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16dd6-0e72-4f32-aa4b-44f65691ecb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:07.446761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16dd6-0e72-4f32-aa4b-44f65691ecb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:07.448376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5bd16dd6-0e72-4f32-aa4b-44f65691ecb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:07.566334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16dd6-0e72-4f32-aa4b-44f65691ecb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:07.567761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16dd6-0e72-4f32-aa4b-44f65691ecb1 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:07.589019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 662/1319] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:10.039101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50336fdf-6afd-4a2e-905a-7809c149474e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:10.039667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50336fdf-6afd-4a2e-905a-7809c149474e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:10.039667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50336fdf-6afd-4a2e-905a-7809c149474e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:10.041108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 658/1320] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:10.050130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594344f-8f30-4491-a10e-e8319594369c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:10.050994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594344f-8f30-4491-a10e-e8319594369c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:10.050994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594344f-8f30-4491-a10e-e8319594369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:10.105393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:10.140391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d594344f-8f30-4491-a10e-e8319594369c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:10.141650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d594344f-8f30-4491-a10e-e8319594369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:10.264233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 663/1321] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:10.562416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50336fdf-6afd-4a2e-905a-7809c149474e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:10.563977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-50336fdf-6afd-4a2e-905a-7809c149474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:10.697703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50336fdf-6afd-4a2e-905a-7809c149474e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:10.782428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066d18a-21a0-49e9-b0da-da160c0be1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:10.783080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066d18a-21a0-49e9-b0da-da160c0be1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:10.783355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066d18a-21a0-49e9-b0da-da160c0be1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:10.783604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066d18a-21a0-49e9-b0da-da160c0be1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:10.785217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5066d18a-21a0-49e9-b0da-da160c0be1f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:10.793093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:10.905114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066d18a-21a0-49e9-b0da-da160c0be1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:10.906456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066d18a-21a0-49e9-b0da-da160c0be1f4 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:10.925166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 659/1322] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:13.525204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009538-b72a-4f22-b2d7-08bab4f239e0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:13.525751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009538-b72a-4f22-b2d7-08bab4f239e0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:13.525751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009538-b72a-4f22-b2d7-08bab4f239e0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:13.527211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 664/1323] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:13.532852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880dcbc-52f6-4520-95ba-d5e4062f09ad None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:13.533332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880dcbc-52f6-4520-95ba-d5e4062f09ad None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:13.533445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880dcbc-52f6-4520-95ba-d5e4062f09ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:13.605730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3880dcbc-52f6-4520-95ba-d5e4062f09ad None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:13.607502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3880dcbc-52f6-4520-95ba-d5e4062f09ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:13.668023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:13.710133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 660/1324] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:13.987724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009538-b72a-4f22-b2d7-08bab4f239e0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:13.989279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dc009538-b72a-4f22-b2d7-08bab4f239e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:14.101942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009538-b72a-4f22-b2d7-08bab4f239e0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:14.115184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:14.180687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4203294-bba2-4103-bea1-7d8d972e8bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:14.181303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203294-bba2-4103-bea1-7d8d972e8bbb service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:14.181577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203294-bba2-4103-bea1-7d8d972e8bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:14.181846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203294-bba2-4103-bea1-7d8d972e8bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:14.183525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c4203294-bba2-4103-bea1-7d8d972e8bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:14.312104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4203294-bba2-4103-bea1-7d8d972e8bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:14.313433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4203294-bba2-4103-bea1-7d8d972e8bbb service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:14.333329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 665/1325] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:16.306794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ae63-4e1b-4233-945d-7446ea306a69 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:16.307328 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ae63-4e1b-4233-945d-7446ea306a69 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:16.307328 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ae63-4e1b-4233-945d-7446ea306a69 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:16.308621 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 661/1326] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:16.314114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecd428-b9b8-4922-923f-4f93fdf0fc1b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:16.314580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecd428-b9b8-4922-923f-4f93fdf0fc1b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:16.314873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecd428-b9b8-4922-923f-4f93fdf0fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:16.369329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:16.390230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-79ecd428-b9b8-4922-923f-4f93fdf0fc1b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:16.391482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-79ecd428-b9b8-4922-923f-4f93fdf0fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:16.494132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 666/1327] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:16.775085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8ae63-4e1b-4233-945d-7446ea306a69 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:16.776856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-afd8ae63-4e1b-4233-945d-7446ea306a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:16.888692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8ae63-4e1b-4233-945d-7446ea306a69 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:16.981028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af41367-a5b8-44d6-90c3-65d48694ca7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:16.981961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af41367-a5b8-44d6-90c3-65d48694ca7e service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:16.982230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af41367-a5b8-44d6-90c3-65d48694ca7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:16.982521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af41367-a5b8-44d6-90c3-65d48694ca7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:16.984185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9af41367-a5b8-44d6-90c3-65d48694ca7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:17.004830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:17.103763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af41367-a5b8-44d6-90c3-65d48694ca7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:17.105359 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af41367-a5b8-44d6-90c3-65d48694ca7e service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:17.126017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 662/1328] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:19.115238 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5f75-5cbc-4fb3-b80e-d2e359475775 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:19.116065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5f75-5cbc-4fb3-b80e-d2e359475775 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:19.116065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5f75-5cbc-4fb3-b80e-d2e359475775 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:19.117775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 667/1329] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:19.124477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73930c95-876b-4697-860a-44c1c9cebddc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:19.124956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73930c95-876b-4697-860a-44c1c9cebddc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:19.125070 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73930c95-876b-4697-860a-44c1c9cebddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:19.202457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-73930c95-876b-4697-860a-44c1c9cebddc None None] MFA Rules not processed for user `b81582df34a44b238abda1fb4c41a74a`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:19.203736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-73930c95-876b-4697-860a-44c1c9cebddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:19.268596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:19.306020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 663/1330] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:19.609089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d5f75-5cbc-4fb3-b80e-d2e359475775 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:19.610667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6c6d5f75-5cbc-4fb3-b80e-d2e359475775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:19.725850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d5f75-5cbc-4fb3-b80e-d2e359475775 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:19.746634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:19.806243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40656e3c-44b9-4c3a-8d93-80759d06c57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:19.806881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40656e3c-44b9-4c3a-8d93-80759d06c57e service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:19.807151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40656e3c-44b9-4c3a-8d93-80759d06c57e service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:19.807410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40656e3c-44b9-4c3a-8d93-80759d06c57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:19.809182 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-40656e3c-44b9-4c3a-8d93-80759d06c57e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:19.935158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40656e3c-44b9-4c3a-8d93-80759d06c57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:19.936627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40656e3c-44b9-4c3a-8d93-80759d06c57e service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:19.957235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 668/1331] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:22.136518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592015f-d647-4a57-8b3f-2d421dd3273d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:22.137147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592015f-d647-4a57-8b3f-2d421dd3273d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:22.137147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592015f-d647-4a57-8b3f-2d421dd3273d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:22.139137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 664/1332] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:22.148013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f795-5bef-4519-ad41-643fa3a06e31 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:22.148809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f795-5bef-4519-ad41-643fa3a06e31 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:22.148986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f795-5bef-4519-ad41-643fa3a06e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:22.218369 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:22.221706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8931f795-5bef-4519-ad41-643fa3a06e31 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:22.223658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8931f795-5bef-4519-ad41-643fa3a06e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:22.327472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 669/1333] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:22.610256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592015f-d647-4a57-8b3f-2d421dd3273d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:22.611858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3592015f-d647-4a57-8b3f-2d421dd3273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:22.733443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592015f-d647-4a57-8b3f-2d421dd3273d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:22.815195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9538e1-82f8-49e3-bca5-b61f1e249e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:22.815808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9538e1-82f8-49e3-bca5-b61f1e249e7f service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:22.816078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9538e1-82f8-49e3-bca5-b61f1e249e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:22.816340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9538e1-82f8-49e3-bca5-b61f1e249e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:22.817937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fc9538e1-82f8-49e3-bca5-b61f1e249e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:22.847854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:22.939431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9538e1-82f8-49e3-bca5-b61f1e249e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:22.940876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9538e1-82f8-49e3-bca5-b61f1e249e7f service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:22.960052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 665/1334] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:25.045102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c68b1-3b51-4375-b1f8-65d94e3b061c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:25.045867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c68b1-3b51-4375-b1f8-65d94e3b061c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:25.045867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c68b1-3b51-4375-b1f8-65d94e3b061c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:25.047059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 670/1335] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:25.052996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73534829-66c5-4099-91e3-e8a8ac0b7e4f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:25.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73534829-66c5-4099-91e3-e8a8ac0b7e4f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:25.053530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73534829-66c5-4099-91e3-e8a8ac0b7e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:25.145023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-73534829-66c5-4099-91e3-e8a8ac0b7e4f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:25.147135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-73534829-66c5-4099-91e3-e8a8ac0b7e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:25.230635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:25.261631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 666/1336] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:25.544992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c68b1-3b51-4375-b1f8-65d94e3b061c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:25.547505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8c3c68b1-3b51-4375-b1f8-65d94e3b061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:25.682089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c68b1-3b51-4375-b1f8-65d94e3b061c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:25.721318 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:25.785004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e37e8-1801-4d9e-a8dc-40570bbceed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:25.785614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e37e8-1801-4d9e-a8dc-40570bbceed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:25.785885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e37e8-1801-4d9e-a8dc-40570bbceed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:25.786204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e37e8-1801-4d9e-a8dc-40570bbceed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:25.787783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f28e37e8-1801-4d9e-a8dc-40570bbceed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:25.920916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e37e8-1801-4d9e-a8dc-40570bbceed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:25.922370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e37e8-1801-4d9e-a8dc-40570bbceed8 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:25.942599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 671/1337] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:28.495021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e661f8-4785-45fd-bf0e-834350bdaaab None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:28.496407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e661f8-4785-45fd-bf0e-834350bdaaab None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:28.496870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e661f8-4785-45fd-bf0e-834350bdaaab None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:28.499839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 667/1338] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:28.511162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f623c75-8efa-48fb-9d1c-c4eb59167bf7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:28.512013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f623c75-8efa-48fb-9d1c-c4eb59167bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:28.512013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f623c75-8efa-48fb-9d1c-c4eb59167bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:28.597545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0f623c75-8efa-48fb-9d1c-c4eb59167bf7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:28.598790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0f623c75-8efa-48fb-9d1c-c4eb59167bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:28.612025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:28.712507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 672/1339] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:29.004690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e661f8-4785-45fd-bf0e-834350bdaaab None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:29.007273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c7e661f8-4785-45fd-bf0e-834350bdaaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:29.130427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e661f8-4785-45fd-bf0e-834350bdaaab None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:29.216201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddcfcc-4464-4133-aef3-c63b02f557ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:29.216842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddcfcc-4464-4133-aef3-c63b02f557ac service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:29.217095 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddcfcc-4464-4133-aef3-c63b02f557ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:29.217372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddcfcc-4464-4133-aef3-c63b02f557ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:29.219018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-38ddcfcc-4464-4133-aef3-c63b02f557ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:29.258254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:29.343422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddcfcc-4464-4133-aef3-c63b02f557ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:29.344871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddcfcc-4464-4133-aef3-c63b02f557ac service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:29.365188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 668/1340] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:33.374177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaa93f-d3f9-4219-97ab-cb2c6fd626a2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:33.374737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaa93f-d3f9-4219-97ab-cb2c6fd626a2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:33.374857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaa93f-d3f9-4219-97ab-cb2c6fd626a2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:33.376366 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 673/1341] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:33.381900 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc09d7-00f0-45a3-a30f-abdfa914462c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:33.382370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc09d7-00f0-45a3-a30f-abdfa914462c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:33.382478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc09d7-00f0-45a3-a30f-abdfa914462c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:33.455638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fbfc09d7-00f0-45a3-a30f-abdfa914462c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:33.456855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fbfc09d7-00f0-45a3-a30f-abdfa914462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:33.550309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:33.563138 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 669/1342] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:33.850120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaa93f-d3f9-4219-97ab-cb2c6fd626a2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:33.851811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5bdaa93f-d3f9-4219-97ab-cb2c6fd626a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:33.966847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaa93f-d3f9-4219-97ab-cb2c6fd626a2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:34.007881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:34.051673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac2dc4-dd78-4e45-9031-fbe30dffc06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:34.052311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac2dc4-dd78-4e45-9031-fbe30dffc06c service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:34.052591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac2dc4-dd78-4e45-9031-fbe30dffc06c service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:34.052862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac2dc4-dd78-4e45-9031-fbe30dffc06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:34.054554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-27ac2dc4-dd78-4e45-9031-fbe30dffc06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:34.175019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac2dc4-dd78-4e45-9031-fbe30dffc06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:34.176367 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac2dc4-dd78-4e45-9031-fbe30dffc06c service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:34.195610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 674/1343] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:36.928687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90a1a-4819-4ce1-8e36-1d03c46aa644 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:36.929231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90a1a-4819-4ce1-8e36-1d03c46aa644 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:36.929231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90a1a-4819-4ce1-8e36-1d03c46aa644 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:36.930595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 670/1344] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:36.936872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4031e4c-852b-4f6b-b072-6175b516f6e6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:36.937569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4031e4c-852b-4f6b-b072-6175b516f6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:36.937776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4031e4c-852b-4f6b-b072-6175b516f6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:37.008039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e4031e4c-852b-4f6b-b072-6175b516f6e6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:37.009177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e4031e4c-852b-4f6b-b072-6175b516f6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:37.029602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:37.120449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 675/1345] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:24:37.404407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90a1a-4819-4ce1-8e36-1d03c46aa644 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:37.405984 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-40d90a1a-4819-4ce1-8e36-1d03c46aa644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:37.516700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90a1a-4819-4ce1-8e36-1d03c46aa644 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:37.599475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c655f9-a8a3-452d-8456-84fb65fcaa0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:37.600075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c655f9-a8a3-452d-8456-84fb65fcaa0e service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:37.600345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c655f9-a8a3-452d-8456-84fb65fcaa0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:37.600610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c655f9-a8a3-452d-8456-84fb65fcaa0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:37.602234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d5c655f9-a8a3-452d-8456-84fb65fcaa0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:37.653795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:37.728759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c655f9-a8a3-452d-8456-84fb65fcaa0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:37.730201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c655f9-a8a3-452d-8456-84fb65fcaa0e service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:37.751450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 671/1346] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:41.740829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405112-b212-4b72-839c-7078007c6384 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:41.741368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405112-b212-4b72-839c-7078007c6384 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:41.741368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405112-b212-4b72-839c-7078007c6384 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:41.742671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 676/1347] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:41.748697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb370731-b9b8-477e-8982-7d80dde8c845 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:41.749242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb370731-b9b8-477e-8982-7d80dde8c845 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:41.749327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb370731-b9b8-477e-8982-7d80dde8c845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:41.823651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-eb370731-b9b8-477e-8982-7d80dde8c845 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:41.825634 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eb370731-b9b8-477e-8982-7d80dde8c845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:41.932183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:41.935088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 672/1348] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:42.224531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405112-b212-4b72-839c-7078007c6384 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:42.226092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9f405112-b212-4b72-839c-7078007c6384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:42.359509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405112-b212-4b72-839c-7078007c6384 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:42.409888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:42.440042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1eba-ee34-4e17-8ff3-55563d238370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:42.440647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1eba-ee34-4e17-8ff3-55563d238370 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:42.440918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1eba-ee34-4e17-8ff3-55563d238370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:42.441181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1eba-ee34-4e17-8ff3-55563d238370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:42.442809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-81cd1eba-ee34-4e17-8ff3-55563d238370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:42.570839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1eba-ee34-4e17-8ff3-55563d238370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:42.572288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1eba-ee34-4e17-8ff3-55563d238370 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:42.595108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 677/1349] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:24:47.758287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb9fa-b761-4521-af62-f2a4d2decc5a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:47.758731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb9fa-b761-4521-af62-f2a4d2decc5a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:47.758841 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb9fa-b761-4521-af62-f2a4d2decc5a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:47.760560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 673/1350] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:47.767070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f23950-735a-4470-9483-5658ca2bdc39 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:47.767532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f23950-735a-4470-9483-5658ca2bdc39 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:47.767630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f23950-735a-4470-9483-5658ca2bdc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:47.876117 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-33f23950-735a-4470-9483-5658ca2bdc39 None None] MFA Rules not processed for user `496b8b8fa8ad4cc59b7f3d2c48cdd977`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:47.877280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-33f23950-735a-4470-9483-5658ca2bdc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:47.898493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:48.030233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 678/1351] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:24:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:52.227783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419db67-c0a1-4ed6-af78-97e97e0b2901 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:52.228376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419db67-c0a1-4ed6-af78-97e97e0b2901 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:52.228768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419db67-c0a1-4ed6-af78-97e97e0b2901 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:52.230341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 674/1352] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:52.235628 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ddd9-38f8-434d-80f1-3ed67a54d1ef None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:52.236120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ddd9-38f8-434d-80f1-3ed67a54d1ef None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:52.236203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ddd9-38f8-434d-80f1-3ed67a54d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:52.313977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0277ddd9-38f8-434d-80f1-3ed67a54d1ef None None] MFA Rules not processed for user `496b8b8fa8ad4cc59b7f3d2c48cdd977`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:52.315230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0277ddd9-38f8-434d-80f1-3ed67a54d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:52.389379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:52.430027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 679/1353] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:24:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:53.863299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f4fc1-c7a3-4264-9c30-2df36c85385f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:53.863842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f4fc1-c7a3-4264-9c30-2df36c85385f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:53.863842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f4fc1-c7a3-4264-9c30-2df36c85385f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:53.865068 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 675/1354] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:53.870453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e300c1b-2304-47f0-8c4e-f9e537afc116 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:53.870936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e300c1b-2304-47f0-8c4e-f9e537afc116 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:53.871033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e300c1b-2304-47f0-8c4e-f9e537afc116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:53.952766 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1e300c1b-2304-47f0-8c4e-f9e537afc116 None None] MFA Rules not processed for user `496b8b8fa8ad4cc59b7f3d2c48cdd977`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:53.954349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1e300c1b-2304-47f0-8c4e-f9e537afc116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:54.070056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 680/1355] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:57.447532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99130a5-9223-49e0-8561-b0b54c57601f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:57.448118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99130a5-9223-49e0-8561-b0b54c57601f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:57.448118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99130a5-9223-49e0-8561-b0b54c57601f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:57.449856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 676/1356] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:57.455606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a87460-1a9c-4e32-9335-5b8f5c7e40d9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:57.456049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a87460-1a9c-4e32-9335-5b8f5c7e40d9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:57.456049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a87460-1a9c-4e32-9335-5b8f5c7e40d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:57.494556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:57.536005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b8a87460-1a9c-4e32-9335-5b8f5c7e40d9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:57.537426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b8a87460-1a9c-4e32-9335-5b8f5c7e40d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:57.675507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 681/1357] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:57.993404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb09b-85bd-41cc-8db7-34544e6044b6 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:57.994363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb09b-85bd-41cc-8db7-34544e6044b6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:57.995117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb09b-85bd-41cc-8db7-34544e6044b6 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:57.997258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 677/1358] 10.222.0.78 () {54 vars in 962 bytes} [Wed Aug 24 03:24:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:24:58.002877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072160a0-f0b1-4192-8ad7-54d2c4bcd8cd None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:58.003163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072160a0-f0b1-4192-8ad7-54d2c4bcd8cd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:58.003444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072160a0-f0b1-4192-8ad7-54d2c4bcd8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:58.091997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-072160a0-f0b1-4192-8ad7-54d2c4bcd8cd None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:24:58.093432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-072160a0-f0b1-4192-8ad7-54d2c4bcd8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:58.150307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:58.227933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 682/1359] 10.222.0.78 () {58 vars in 1059 bytes} [Wed Aug 24 03:24:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:24:58.235978 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeb09b-85bd-41cc-8db7-34544e6044b6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:24:58.237504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-00aeb09b-85bd-41cc-8db7-34544e6044b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:58.396389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeb09b-85bd-41cc-8db7-34544e6044b6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:24:58.477365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:58.531146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3510e97-9f36-44d5-ba3c-2133a28ee11e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:24:58.531756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510e97-9f36-44d5-ba3c-2133a28ee11e service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:24:58.532027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510e97-9f36-44d5-ba3c-2133a28ee11e service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:24:58.532298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510e97-9f36-44d5-ba3c-2133a28ee11e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:24:58.533890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d3510e97-9f36-44d5-ba3c-2133a28ee11e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:24:58.645647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3510e97-9f36-44d5-ba3c-2133a28ee11e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:24:58.647835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3510e97-9f36-44d5-ba3c-2133a28ee11e service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:24:58.668680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 678/1360] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:00.810350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba550d08-384a-4c07-8edc-7139dc2a4ad8 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:00.810875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba550d08-384a-4c07-8edc-7139dc2a4ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:00.810986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba550d08-384a-4c07-8edc-7139dc2a4ad8 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:00.812445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 683/1361] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:00.817763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6da00-5ab7-452c-8fd4-3b62cf6921a3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:00.818193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6da00-5ab7-452c-8fd4-3b62cf6921a3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:00.818314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6da00-5ab7-452c-8fd4-3b62cf6921a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:00.891465 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-51d6da00-5ab7-452c-8fd4-3b62cf6921a3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:00.892578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-51d6da00-5ab7-452c-8fd4-3b62cf6921a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:00.933728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:01.025662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 679/1362] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:01.321192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba550d08-384a-4c07-8edc-7139dc2a4ad8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:01.322996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ba550d08-384a-4c07-8edc-7139dc2a4ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:01.529155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba550d08-384a-4c07-8edc-7139dc2a4ad8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:01.539882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:01.680283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b34f51-8984-4ea6-a9dc-cbfd42ce81a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:01.681039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b34f51-8984-4ea6-a9dc-cbfd42ce81a2 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:01.681419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b34f51-8984-4ea6-a9dc-cbfd42ce81a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:01.681742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b34f51-8984-4ea6-a9dc-cbfd42ce81a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:01.684658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-67b34f51-8984-4ea6-a9dc-cbfd42ce81a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:01.792061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b34f51-8984-4ea6-a9dc-cbfd42ce81a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:01.793775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b34f51-8984-4ea6-a9dc-cbfd42ce81a2 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:01.814795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 684/1363] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:04.132805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df98a-62ae-4315-9a05-3e14d420863a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:04.133385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df98a-62ae-4315-9a05-3e14d420863a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:04.133385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df98a-62ae-4315-9a05-3e14d420863a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:04.134985 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 680/1364] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:04.141371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56b1db-71fa-42f9-a702-25a8e1f4ff16 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:04.141878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56b1db-71fa-42f9-a702-25a8e1f4ff16 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:04.141962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56b1db-71fa-42f9-a702-25a8e1f4ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:04.160216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:04.221892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4b56b1db-71fa-42f9-a702-25a8e1f4ff16 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:04.223119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4b56b1db-71fa-42f9-a702-25a8e1f4ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:04.333694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 685/1365] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:04.633944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9504-a58c-47b7-ba85-da5ede4194e9 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:04.634740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9504-a58c-47b7-ba85-da5ede4194e9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:04.635315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9504-a58c-47b7-ba85-da5ede4194e9 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:04.637049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 681/1366] 10.222.0.78 () {54 vars in 962 bytes} [Wed Aug 24 03:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:04.643214 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479469f-793f-4db7-9deb-92675b639c00 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:04.643650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479469f-793f-4db7-9deb-92675b639c00 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:04.644127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479469f-793f-4db7-9deb-92675b639c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:04.735040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b479469f-793f-4db7-9deb-92675b639c00 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:04.736492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b479469f-793f-4db7-9deb-92675b639c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:04.773414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:04.864948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 686/1367] 10.222.0.78 () {58 vars in 1059 bytes} [Wed Aug 24 03:25:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:04.873320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec9504-a58c-47b7-ba85-da5ede4194e9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:04.874934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e3ec9504-a58c-47b7-ba85-da5ede4194e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:05.064375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec9504-a58c-47b7-ba85-da5ede4194e9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:05.087707 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:05.188962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d3561-8d43-4895-b877-a22f77ec0f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:05.189681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3561-8d43-4895-b877-a22f77ec0f51 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:05.189929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3561-8d43-4895-b877-a22f77ec0f51 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:05.190096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3561-8d43-4895-b877-a22f77ec0f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:05.192391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7c0d3561-8d43-4895-b877-a22f77ec0f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:05.291916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d3561-8d43-4895-b877-a22f77ec0f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:05.293689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d3561-8d43-4895-b877-a22f77ec0f51 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:05.316007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 682/1368] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:05.855708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4b175-620b-4cab-ae99-ee62eac56566 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:05.856317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4b175-620b-4cab-ae99-ee62eac56566 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:05.856317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4b175-620b-4cab-ae99-ee62eac56566 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:05.857997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 687/1369] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:05.863555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3c496-cd15-4504-88c9-e275e8bd82ea None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:05.863809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3c496-cd15-4504-88c9-e275e8bd82ea None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:05.864035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3c496-cd15-4504-88c9-e275e8bd82ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:05.897646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:05.939462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-94e3c496-cd15-4504-88c9-e275e8bd82ea None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:05.940698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-94e3c496-cd15-4504-88c9-e275e8bd82ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:06.050686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 683/1370] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:06.613272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b844d-021f-4596-a6d7-8a4bc2456f48 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:06.613725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b844d-021f-4596-a6d7-8a4bc2456f48 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:06.614139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b844d-021f-4596-a6d7-8a4bc2456f48 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:06.616122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 688/1371] 10.222.0.78 () {54 vars in 964 bytes} [Wed Aug 24 03:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:06.622064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92ade6-da77-49b7-a1ae-b528f95c6718 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:06.622578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92ade6-da77-49b7-a1ae-b528f95c6718 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:06.622578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92ade6-da77-49b7-a1ae-b528f95c6718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:06.704925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fb92ade6-da77-49b7-a1ae-b528f95c6718 None None] MFA Rules not processed for user `e736e983399140c2a7e6ee2c9e297021`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:06.706150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fb92ade6-da77-49b7-a1ae-b528f95c6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:06.755995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:06.791619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 684/1372] 10.222.0.78 () {58 vars in 1061 bytes} [Wed Aug 24 03:25:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:25:06.799370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b844d-021f-4596-a6d7-8a4bc2456f48 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:06.800930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-721b844d-021f-4596-a6d7-8a4bc2456f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:06.914124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b844d-021f-4596-a6d7-8a4bc2456f48 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:06.959159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:06.996886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3f7cc-a6d5-40d6-941a-1299c9074c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:06.997513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3f7cc-a6d5-40d6-941a-1299c9074c81 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:06.997781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3f7cc-a6d5-40d6-941a-1299c9074c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:06.998060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3f7cc-a6d5-40d6-941a-1299c9074c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:06.999720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1bd3f7cc-a6d5-40d6-941a-1299c9074c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:07.150864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3f7cc-a6d5-40d6-941a-1299c9074c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:07.153159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3f7cc-a6d5-40d6-941a-1299c9074c81 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:07.187077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 689/1373] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:07.345086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7259e0-719d-4ce1-9740-a876e3156404 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:07.345086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7259e0-719d-4ce1-9740-a876e3156404 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:07.345086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7259e0-719d-4ce1-9740-a876e3156404 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:07.345086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 685/1374] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:07.350778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04103c67-6950-4cac-96cd-63c5a7ef111d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:07.351303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04103c67-6950-4cac-96cd-63c5a7ef111d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:07.351854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04103c67-6950-4cac-96cd-63c5a7ef111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:07.441961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-04103c67-6950-4cac-96cd-63c5a7ef111d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:07.443433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-04103c67-6950-4cac-96cd-63c5a7ef111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:07.465004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:07.543304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 690/1375] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:07.833120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7259e0-719d-4ce1-9740-a876e3156404 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:07.834709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2f7259e0-719d-4ce1-9740-a876e3156404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:08.015971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7259e0-719d-4ce1-9740-a876e3156404 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:08.079215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:08.158534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b0479-791e-4789-8d22-df633aab0bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:08.159179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b0479-791e-4789-8d22-df633aab0bd0 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:08.159449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b0479-791e-4789-8d22-df633aab0bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:08.159715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b0479-791e-4789-8d22-df633aab0bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:08.161366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-442b0479-791e-4789-8d22-df633aab0bd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:08.261995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b0479-791e-4789-8d22-df633aab0bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:08.263717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b0479-791e-4789-8d22-df633aab0bd0 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:08.283065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 686/1376] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:10.251249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0543-339b-454f-b5a6-6b61eb8d11d9 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:10.251826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0543-339b-454f-b5a6-6b61eb8d11d9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:10.251826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0543-339b-454f-b5a6-6b61eb8d11d9 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:10.253123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 691/1377] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:10.258890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de37d0-c602-4a6a-8c37-5362a9f3b865 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:10.259328 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de37d0-c602-4a6a-8c37-5362a9f3b865 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:10.259473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de37d0-c602-4a6a-8c37-5362a9f3b865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:10.331999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-24de37d0-c602-4a6a-8c37-5362a9f3b865 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:10.333322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-24de37d0-c602-4a6a-8c37-5362a9f3b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:10.340514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:10.441728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 687/1378] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:10.836374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0543-339b-454f-b5a6-6b61eb8d11d9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:10.838020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5eca0543-339b-454f-b5a6-6b61eb8d11d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:11.058926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0543-339b-454f-b5a6-6b61eb8d11d9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:11.065155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:11.208555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c731228-f85d-4aa0-83aa-b75d016187a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:11.209171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731228-f85d-4aa0-83aa-b75d016187a9 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:11.209440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731228-f85d-4aa0-83aa-b75d016187a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:11.209704 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731228-f85d-4aa0-83aa-b75d016187a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:11.211354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8c731228-f85d-4aa0-83aa-b75d016187a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:11.315072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c731228-f85d-4aa0-83aa-b75d016187a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:11.316695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c731228-f85d-4aa0-83aa-b75d016187a9 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:11.336530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 692/1379] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:13.337880 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8bd0-2e08-4060-9868-5b8b189c2315 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:13.338464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8bd0-2e08-4060-9868-5b8b189c2315 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:13.338464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8bd0-2e08-4060-9868-5b8b189c2315 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:13.340073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 688/1380] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:13.345591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c7545-9424-4cc6-bfe2-8263d2671a9e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:13.346092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c7545-9424-4cc6-bfe2-8263d2671a9e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:13.346092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c7545-9424-4cc6-bfe2-8263d2671a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:13.360936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:13.424070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1b8c7545-9424-4cc6-bfe2-8263d2671a9e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:13.425424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1b8c7545-9424-4cc6-bfe2-8263d2671a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:13.534936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 693/1381] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:13.827085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8bd0-2e08-4060-9868-5b8b189c2315 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:13.827085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cf4e8bd0-2e08-4060-9868-5b8b189c2315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:13.988478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:14.000042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8bd0-2e08-4060-9868-5b8b189c2315 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:14.129369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c979-04d9-4bc9-a037-1f9649514886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:14.130481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c979-04d9-4bc9-a037-1f9649514886 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:14.131062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c979-04d9-4bc9-a037-1f9649514886 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:14.131538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c979-04d9-4bc9-a037-1f9649514886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:14.133543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2271c979-04d9-4bc9-a037-1f9649514886 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:14.239245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c979-04d9-4bc9-a037-1f9649514886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:14.240857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c979-04d9-4bc9-a037-1f9649514886 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:14.252105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:14.266840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 689/1382] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:16.548825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08993d18-419b-49db-b052-dc52aeee466c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:16.549449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08993d18-419b-49db-b052-dc52aeee466c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:16.549652 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08993d18-419b-49db-b052-dc52aeee466c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:16.553078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 694/1383] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:16.563543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314980a-1897-498f-88fc-2a1a052faa9d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:16.564350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314980a-1897-498f-88fc-2a1a052faa9d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:16.564350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314980a-1897-498f-88fc-2a1a052faa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:16.660541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d314980a-1897-498f-88fc-2a1a052faa9d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:16.662320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d314980a-1897-498f-88fc-2a1a052faa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:16.794357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 690/1384] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:25:17.089486 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08993d18-419b-49db-b052-dc52aeee466c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:17.091123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-08993d18-419b-49db-b052-dc52aeee466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:17.199454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:17.290146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08993d18-419b-49db-b052-dc52aeee466c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:17.442923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f5b28-af49-40eb-9424-8d201965921c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:17.443518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f5b28-af49-40eb-9424-8d201965921c service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:17.444120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f5b28-af49-40eb-9424-8d201965921c service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:17.444377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f5b28-af49-40eb-9424-8d201965921c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:17.446006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-169f5b28-af49-40eb-9424-8d201965921c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:17.504417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:17.551595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f5b28-af49-40eb-9424-8d201965921c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:17.553271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f5b28-af49-40eb-9424-8d201965921c service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:17.573679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 695/1385] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:25:20.183947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b93891-17b6-4cd0-8d93-49b555c3eaf1 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:20.184695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b93891-17b6-4cd0-8d93-49b555c3eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:20.184816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b93891-17b6-4cd0-8d93-49b555c3eaf1 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:20.186459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 691/1386] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:20.194509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853eab-c2d5-4a5e-b1b2-09ef0d27c731 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:20.195101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853eab-c2d5-4a5e-b1b2-09ef0d27c731 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:20.195515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853eab-c2d5-4a5e-b1b2-09ef0d27c731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:20.296551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f2853eab-c2d5-4a5e-b1b2-09ef0d27c731 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:20.297896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f2853eab-c2d5-4a5e-b1b2-09ef0d27c731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:20.450453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 696/1387] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:20.764740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b93891-17b6-4cd0-8d93-49b555c3eaf1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:20.766862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-01b93891-17b6-4cd0-8d93-49b555c3eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:20.862520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:20.957266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b93891-17b6-4cd0-8d93-49b555c3eaf1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:21.089044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc64ab9-5786-43ad-b24b-cde68ae237ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:21.089566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc64ab9-5786-43ad-b24b-cde68ae237ed service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:21.089830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc64ab9-5786-43ad-b24b-cde68ae237ed service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:21.090104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc64ab9-5786-43ad-b24b-cde68ae237ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:21.091742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cbc64ab9-5786-43ad-b24b-cde68ae237ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:21.131803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:21.200970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc64ab9-5786-43ad-b24b-cde68ae237ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:21.203033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc64ab9-5786-43ad-b24b-cde68ae237ed service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:21.228299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 692/1388] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:22.637606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1467-0850-4be5-812e-26210a7aa088 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.638219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1467-0850-4be5-812e-26210a7aa088 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.638219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce1467-0850-4be5-812e-26210a7aa088 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.639445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 697/1389] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:22.644950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803f28e-aaa1-46c2-b4ef-f8613d5b2f8f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.645411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803f28e-aaa1-46c2-b4ef-f8613d5b2f8f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.645570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803f28e-aaa1-46c2-b4ef-f8613d5b2f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.735644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b803f28e-aaa1-46c2-b4ef-f8613d5b2f8f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:22.736913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b803f28e-aaa1-46c2-b4ef-f8613d5b2f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:22.846009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 693/1390] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:23.158613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e348af-499b-4b63-8bb0-738fa5b0d3eb None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.158896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e348af-499b-4b63-8bb0-738fa5b0d3eb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.159160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e348af-499b-4b63-8bb0-738fa5b0d3eb None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.160519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 698/1391] 10.222.0.78 () {54 vars in 967 bytes} [Wed Aug 24 03:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:23.166011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e891e7-adeb-4d93-8355-1ab2dfbfa3e2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.166462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e891e7-adeb-4d93-8355-1ab2dfbfa3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.167308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e891e7-adeb-4d93-8355-1ab2dfbfa3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.187846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.256127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa709-653c-471b-a414-061c404a2bfb None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.256393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa709-653c-471b-a414-061c404a2bfb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.256850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa709-653c-471b-a414-061c404a2bfb None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.258521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 699/1392] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:23.262133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-05e891e7-adeb-4d93-8355-1ab2dfbfa3e2 None None] MFA Rules not processed for user `d6c0b33c2c7947c59ebf8da17abbd0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:23.263499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-05e891e7-adeb-4d93-8355-1ab2dfbfa3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:23.264154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabbd3d-0ac1-4e7f-9324-886b4edb973d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.264436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabbd3d-0ac1-4e7f-9324-886b4edb973d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.264715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabbd3d-0ac1-4e7f-9324-886b4edb973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.305993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.351924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3aabbd3d-0ac1-4e7f-9324-886b4edb973d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:23.352835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 694/1393] 10.222.0.78 () {58 vars in 1064 bytes} [Wed Aug 24 03:25:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:23.353142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3aabbd3d-0ac1-4e7f-9324-886b4edb973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:23.362181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e891e7-adeb-4d93-8355-1ab2dfbfa3e2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:23.372871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e891e7-adeb-4d93-8355-1ab2dfbfa3e2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:23.451727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00e6ef-3694-410e-8c1c-4d95fbb9cd7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c0b33c2c7947c59ebf8da17abbd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:23.452351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00e6ef-3694-410e-8c1c-4d95fbb9cd7c service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.452629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00e6ef-3694-410e-8c1c-4d95fbb9cd7c service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.452896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00e6ef-3694-410e-8c1c-4d95fbb9cd7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.454559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1c00e6ef-3694-410e-8c1c-4d95fbb9cd7c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:23.464062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 700/1394] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:25:23.491309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.576449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00e6ef-3694-410e-8c1c-4d95fbb9cd7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:23.577906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00e6ef-3694-410e-8c1c-4d95fbb9cd7c service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:23.602667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 695/1395] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:23.753333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabbd3d-0ac1-4e7f-9324-886b4edb973d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:23.755287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3aabbd3d-0ac1-4e7f-9324-886b4edb973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:23.893269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.902499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabbd3d-0ac1-4e7f-9324-886b4edb973d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:24.071082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04450b74-076d-424d-8941-02000ef3d6be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:24.071707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04450b74-076d-424d-8941-02000ef3d6be service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:24.071982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04450b74-076d-424d-8941-02000ef3d6be service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:24.072254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04450b74-076d-424d-8941-02000ef3d6be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:24.074216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-04450b74-076d-424d-8941-02000ef3d6be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:24.174788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04450b74-076d-424d-8941-02000ef3d6be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:24.176436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04450b74-076d-424d-8941-02000ef3d6be service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:24.194378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:24.197686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 701/1396] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:24.427009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a310c74-c276-4555-8801-81f035487d1a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:24.427740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a310c74-c276-4555-8801-81f035487d1a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:24.427740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a310c74-c276-4555-8801-81f035487d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:24.523194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5a310c74-c276-4555-8801-81f035487d1a None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:24.524956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5a310c74-c276-4555-8801-81f035487d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:24.640298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:24.647227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 696/1397] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:25:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:24.701255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afed03-f1db-4e86-870e-a7949643b489 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:24.701556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afed03-f1db-4e86-870e-a7949643b489 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:24.701816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afed03-f1db-4e86-870e-a7949643b489 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:24.703245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 702/1398] 10.222.0.78 () {54 vars in 943 bytes} [Wed Aug 24 03:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:24.709888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba664e9e-ee66-4524-8d99-3b04116bc984 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:24.710155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba664e9e-ee66-4524-8d99-3b04116bc984 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:24.710423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba664e9e-ee66-4524-8d99-3b04116bc984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:24.798754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ba664e9e-ee66-4524-8d99-3b04116bc984 None None] MFA Rules not processed for user `c72dc03535044d6a97a953256839d413`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:24.799907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ba664e9e-ee66-4524-8d99-3b04116bc984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:24.950181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 697/1399] 10.222.0.78 () {58 vars in 1040 bytes} [Wed Aug 24 03:25:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:24.960792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afed03-f1db-4e86-870e-a7949643b489 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:24.962437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-22afed03-f1db-4e86-870e-a7949643b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:25.149734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afed03-f1db-4e86-870e-a7949643b489 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:25.254051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:25.284105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f548c-30a4-4dd9-bef7-c43f231bc9b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:25.284105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f548c-30a4-4dd9-bef7-c43f231bc9b8 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.284105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f548c-30a4-4dd9-bef7-c43f231bc9b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.284105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f548c-30a4-4dd9-bef7-c43f231bc9b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.285807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-684f548c-30a4-4dd9-bef7-c43f231bc9b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:25.379114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f548c-30a4-4dd9-bef7-c43f231bc9b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:25.380781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f548c-30a4-4dd9-bef7-c43f231bc9b8 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:25.390315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 703/1400] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:25:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:25:26.424721 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1380b-5c4f-4203-a7ad-5eadf642b45b None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.428077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1380b-5c4f-4203-a7ad-5eadf642b45b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.428077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1380b-5c4f-4203-a7ad-5eadf642b45b None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.428275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 698/1401] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:26.432542 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c2f4-5486-4450-92c6-9e9cd5e288d9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.433051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c2f4-5486-4450-92c6-9e9cd5e288d9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.433176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c2f4-5486-4450-92c6-9e9cd5e288d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.514621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ef99c2f4-5486-4450-92c6-9e9cd5e288d9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:26.516019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ef99c2f4-5486-4450-92c6-9e9cd5e288d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:26.605421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.640364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 704/1402] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:26.930320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1380b-5c4f-4203-a7ad-5eadf642b45b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.932156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-25c1380b-5c4f-4203-a7ad-5eadf642b45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:27.000819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:27.120657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1380b-5c4f-4203-a7ad-5eadf642b45b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.270331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7741b-7e1b-4871-b300-914a048d7ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.271263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7741b-7e1b-4871-b300-914a048d7ac5 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.271675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7741b-7e1b-4871-b300-914a048d7ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.272077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7741b-7e1b-4871-b300-914a048d7ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.274555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2fb7741b-7e1b-4871-b300-914a048d7ac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:27.294882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:27.387376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7741b-7e1b-4871-b300-914a048d7ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.388987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7741b-7e1b-4871-b300-914a048d7ac5 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.412647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 699/1403] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:29.425201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06533054-8932-4fa6-b098-81dcff5f149e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:29.425749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06533054-8932-4fa6-b098-81dcff5f149e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:29.425749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06533054-8932-4fa6-b098-81dcff5f149e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:29.427564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 705/1404] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:29.435586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1af0ef-66ce-4728-8bd5-1f582556c503 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:29.436134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1af0ef-66ce-4728-8bd5-1f582556c503 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:29.436134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1af0ef-66ce-4728-8bd5-1f582556c503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:29.517336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3c1af0ef-66ce-4728-8bd5-1f582556c503 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:29.518576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3c1af0ef-66ce-4728-8bd5-1f582556c503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:29.632962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:29.642474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 700/1405] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:29.939204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06533054-8932-4fa6-b098-81dcff5f149e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:29.940879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-06533054-8932-4fa6-b098-81dcff5f149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:30.195725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06533054-8932-4fa6-b098-81dcff5f149e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.257777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.323943 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ad950-0d83-4db1-a2f4-a6d7203fb29e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.324570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ad950-0d83-4db1-a2f4-a6d7203fb29e service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.324848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ad950-0d83-4db1-a2f4-a6d7203fb29e service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.325115 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ad950-0d83-4db1-a2f4-a6d7203fb29e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.326770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-465ad950-0d83-4db1-a2f4-a6d7203fb29e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:30.426457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ad950-0d83-4db1-a2f4-a6d7203fb29e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.429043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ad950-0d83-4db1-a2f4-a6d7203fb29e service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.451268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 706/1406] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:32.494570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c049c27-bdd5-4425-9a3c-352bd816ee36 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:32.495632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c049c27-bdd5-4425-9a3c-352bd816ee36 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:32.495632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c049c27-bdd5-4425-9a3c-352bd816ee36 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:32.500497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 701/1407] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:32.502178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecf85-02ce-4b76-9570-46f830393e9d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:32.502607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecf85-02ce-4b76-9570-46f830393e9d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:32.502832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecf85-02ce-4b76-9570-46f830393e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:32.572988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3e5ecf85-02ce-4b76-9570-46f830393e9d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:32.573946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e5ecf85-02ce-4b76-9570-46f830393e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:32.595957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:32.710958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 707/1408] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:33.023992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c049c27-bdd5-4425-9a3c-352bd816ee36 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:33.025773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0c049c27-bdd5-4425-9a3c-352bd816ee36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:33.198671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c049c27-bdd5-4425-9a3c-352bd816ee36 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:33.274477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:33.331872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64afc31-bcf0-43a7-926a-802eff0978e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:33.332640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64afc31-bcf0-43a7-926a-802eff0978e6 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:33.332904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64afc31-bcf0-43a7-926a-802eff0978e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:33.333166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64afc31-bcf0-43a7-926a-802eff0978e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:33.334775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c64afc31-bcf0-43a7-926a-802eff0978e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:33.436202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64afc31-bcf0-43a7-926a-802eff0978e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:33.437838 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64afc31-bcf0-43a7-926a-802eff0978e6 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:33.457614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 702/1409] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:42.708960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=37 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.455118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=65 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:47.451601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dbe92-0687-49fc-9789-9de72e8e68f0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.452193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dbe92-0687-49fc-9789-9de72e8e68f0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.452193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dbe92-0687-49fc-9789-9de72e8e68f0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.453543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 708/1410] 10.222.0.78 () {54 vars in 918 bytes} [Wed Aug 24 03:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:47.459012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496118-54a4-446e-b164-5ab3b5fce6dc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.459465 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496118-54a4-446e-b164-5ab3b5fce6dc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.459573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496118-54a4-446e-b164-5ab3b5fce6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.539841 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-85496118-54a4-446e-b164-5ab3b5fce6dc None None] MFA Rules not processed for user `496b8b8fa8ad4cc59b7f3d2c48cdd977`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:47.541188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-85496118-54a4-446e-b164-5ab3b5fce6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:47.675967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 703/1411] 10.222.0.78 () {58 vars in 1015 bytes} [Wed Aug 24 03:25:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:47.692654 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc848-ab87-4fff-891d-eb3b449ac2e4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.692932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc848-ab87-4fff-891d-eb3b449ac2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.693211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc848-ab87-4fff-891d-eb3b449ac2e4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.694949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 709/1412] 10.222.0.78 () {54 vars in 918 bytes} [Wed Aug 24 03:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:47.700680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4eeaa-69c1-44d4-8371-2271b5244dcd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.700962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4eeaa-69c1-44d4-8371-2271b5244dcd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.701233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4eeaa-69c1-44d4-8371-2271b5244dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.780295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:47.784376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b3f4eeaa-69c1-44d4-8371-2271b5244dcd None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:47.786338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b3f4eeaa-69c1-44d4-8371-2271b5244dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:47.911469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 704/1413] 10.222.0.78 () {58 vars in 1015 bytes} [Wed Aug 24 03:25:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:50.338462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e650-223d-401c-bf66-c0fd836099f8 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.339111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e650-223d-401c-bf66-c0fd836099f8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.339111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e650-223d-401c-bf66-c0fd836099f8 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.340391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:50.346793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ab2a-0370-4e27-bc8c-90e697916e7c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.347268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ab2a-0370-4e27-bc8c-90e697916e7c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.347373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ab2a-0370-4e27-bc8c-90e697916e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.425936 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-95c7ab2a-0370-4e27-bc8c-90e697916e7c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:50.427255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-95c7ab2a-0370-4e27-bc8c-90e697916e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:50.497241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.547741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:50.855739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e650-223d-401c-bf66-c0fd836099f8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.857469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-76d3e650-223d-401c-bf66-c0fd836099f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:51.017871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e650-223d-401c-bf66-c0fd836099f8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.107404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.156448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7763b8-5c8f-407f-9b7a-4cab066f739d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.157060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7763b8-5c8f-407f-9b7a-4cab066f739d service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.157336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7763b8-5c8f-407f-9b7a-4cab066f739d service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.157601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7763b8-5c8f-407f-9b7a-4cab066f739d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.159261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4c7763b8-5c8f-407f-9b7a-4cab066f739d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:51.267108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7763b8-5c8f-407f-9b7a-4cab066f739d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.268793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7763b8-5c8f-407f-9b7a-4cab066f739d service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.289867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 711/1416] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:52.208033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd812e66-c63b-46fb-a8b3-ef07702170e7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.208660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd812e66-c63b-46fb-a8b3-ef07702170e7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.208660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd812e66-c63b-46fb-a8b3-ef07702170e7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.209938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:52.215437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94f158-94a5-4acc-b46e-81b8a73b8dce None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.215905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94f158-94a5-4acc-b46e-81b8a73b8dce None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.216022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94f158-94a5-4acc-b46e-81b8a73b8dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.307908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ac94f158-94a5-4acc-b46e-81b8a73b8dce None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:52.309177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ac94f158-94a5-4acc-b46e-81b8a73b8dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:52.337295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.411319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:52.564693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd812e66-c63b-46fb-a8b3-ef07702170e7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.566785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bd812e66-c63b-46fb-a8b3-ef07702170e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:52.737598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd812e66-c63b-46fb-a8b3-ef07702170e7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.781812 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.859467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550699cb-61b6-4326-a8da-c3031de5ebc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.859985 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550699cb-61b6-4326-a8da-c3031de5ebc3 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.860256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550699cb-61b6-4326-a8da-c3031de5ebc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.860521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550699cb-61b6-4326-a8da-c3031de5ebc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.862151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-550699cb-61b6-4326-a8da-c3031de5ebc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:52.960739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550699cb-61b6-4326-a8da-c3031de5ebc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.962379 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550699cb-61b6-4326-a8da-c3031de5ebc3 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.982392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 707/1419] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:53.895089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e1096-8ca9-4720-9c14-1bdd301f4b2e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.895956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e1096-8ca9-4720-9c14-1bdd301f4b2e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.895956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e1096-8ca9-4720-9c14-1bdd301f4b2e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.897973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:25:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:53.905446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375104-4181-4465-bfba-42a006d0ca43 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.906178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375104-4181-4465-bfba-42a006d0ca43 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.906178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375104-4181-4465-bfba-42a006d0ca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.969586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.994940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5d375104-4181-4465-bfba-42a006d0ca43 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:53.996193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5d375104-4181-4465-bfba-42a006d0ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:54.111281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:25:54.265253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e1096-8ca9-4720-9c14-1bdd301f4b2e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.266866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d06e1096-8ca9-4720-9c14-1bdd301f4b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:54.429677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e1096-8ca9-4720-9c14-1bdd301f4b2e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.442540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.564509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdbb87-9a13-458d-b7dc-dae4e65cf2d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.565023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdbb87-9a13-458d-b7dc-dae4e65cf2d4 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.565297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdbb87-9a13-458d-b7dc-dae4e65cf2d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.565561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdbb87-9a13-458d-b7dc-dae4e65cf2d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.567212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b3cdbb87-9a13-458d-b7dc-dae4e65cf2d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:54.674675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdbb87-9a13-458d-b7dc-dae4e65cf2d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.676297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdbb87-9a13-458d-b7dc-dae4e65cf2d4 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.696445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 714/1422] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:55.575431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91329-ad42-40bc-b276-53fd2a97a9f7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.576368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91329-ad42-40bc-b276-53fd2a97a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.576368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91329-ad42-40bc-b276-53fd2a97a9f7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.578447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:25:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:55.584691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22c6cc-1b89-4413-b04e-c369b531288c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.585474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22c6cc-1b89-4413-b04e-c369b531288c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.585626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22c6cc-1b89-4413-b04e-c369b531288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.609073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:55.672307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3e22c6cc-1b89-4413-b04e-c369b531288c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:55.673524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e22c6cc-1b89-4413-b04e-c369b531288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:55.789202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:55.944740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91329-ad42-40bc-b276-53fd2a97a9f7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:55.947598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fef91329-ad42-40bc-b276-53fd2a97a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:56.071747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.110666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91329-ad42-40bc-b276-53fd2a97a9f7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.234190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4de1-855f-411a-9064-997dbbac9e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.234707 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4de1-855f-411a-9064-997dbbac9e1a service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.235007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4de1-855f-411a-9064-997dbbac9e1a service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.235270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4de1-855f-411a-9064-997dbbac9e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.236865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6f0f4de1-855f-411a-9064-997dbbac9e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:56.324190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.338813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f4de1-855f-411a-9064-997dbbac9e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.340433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f4de1-855f-411a-9064-997dbbac9e1a service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.364276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 710/1425] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:57.235604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a56cf2-955a-48a3-a1f3-b5e54a6be355 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.236525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a56cf2-955a-48a3-a1f3-b5e54a6be355 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.236525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a56cf2-955a-48a3-a1f3-b5e54a6be355 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.238575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:25:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:57.244510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f63695-ced9-4a5d-a0c8-63a8d60e459e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.245220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f63695-ced9-4a5d-a0c8-63a8d60e459e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.245471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f63695-ced9-4a5d-a0c8-63a8d60e459e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.336716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-74f63695-ced9-4a5d-a0c8-63a8d60e459e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:57.338303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-74f63695-ced9-4a5d-a0c8-63a8d60e459e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:57.452306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:25:57.603021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a56cf2-955a-48a3-a1f3-b5e54a6be355 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.604541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e4a56cf2-955a-48a3-a1f3-b5e54a6be355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:57.700122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.782621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a56cf2-955a-48a3-a1f3-b5e54a6be355 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.910330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b9559-c963-41bf-b507-0255aa06e0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.910889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b9559-c963-41bf-b507-0255aa06e0f4 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.911164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b9559-c963-41bf-b507-0255aa06e0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.911431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b9559-c963-41bf-b507-0255aa06e0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.913090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1a7b9559-c963-41bf-b507-0255aa06e0f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:57.977481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:58.023365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b9559-c963-41bf-b507-0255aa06e0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.024996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b9559-c963-41bf-b507-0255aa06e0f4 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.046569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 717/1428] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:25:58.864390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472635f-8577-4e91-a662-5250ee56ce75 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.864956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472635f-8577-4e91-a662-5250ee56ce75 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.864956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472635f-8577-4e91-a662-5250ee56ce75 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.866198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:58.872934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e3dd-81c1-439c-8e0d-1d994ff285c5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.873396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e3dd-81c1-439c-8e0d-1d994ff285c5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.873488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e3dd-81c1-439c-8e0d-1d994ff285c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.960457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-44c9e3dd-81c1-439c-8e0d-1d994ff285c5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:58.961716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-44c9e3dd-81c1-439c-8e0d-1d994ff285c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:59.068988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:25:59.227977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472635f-8577-4e91-a662-5250ee56ce75 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:59.230219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9472635f-8577-4e91-a662-5250ee56ce75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:59.281237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:59.386979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472635f-8577-4e91-a662-5250ee56ce75 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:59.516440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758fc85-39db-4c2c-a48d-636127f8c332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:59.516959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758fc85-39db-4c2c-a48d-636127f8c332 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.517232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758fc85-39db-4c2c-a48d-636127f8c332 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.517501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758fc85-39db-4c2c-a48d-636127f8c332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.519158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5758fc85-39db-4c2c-a48d-636127f8c332 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:59.526569 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:59.615466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758fc85-39db-4c2c-a48d-636127f8c332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:59.617101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758fc85-39db-4c2c-a48d-636127f8c332 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:59.636566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 713/1431] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:00.448904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec4f8a-be80-435b-976e-1e8509835880 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.449503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec4f8a-be80-435b-976e-1e8509835880 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.449503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec4f8a-be80-435b-976e-1e8509835880 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.450836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:00.457210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d4315-9eef-45cf-b789-84b9882958a1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.457757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d4315-9eef-45cf-b789-84b9882958a1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.457757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d4315-9eef-45cf-b789-84b9882958a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.562568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c33d4315-9eef-45cf-b789-84b9882958a1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:00.563826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c33d4315-9eef-45cf-b789-84b9882958a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:00.637501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.670015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:26:00.827651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec4f8a-be80-435b-976e-1e8509835880 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.828567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-87ec4f8a-be80-435b-976e-1e8509835880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:00.848559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.996984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec4f8a-be80-435b-976e-1e8509835880 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.096646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.129110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a1024-5314-46fc-815d-f1cf350f6660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.129720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1024-5314-46fc-815d-f1cf350f6660 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.129992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1024-5314-46fc-815d-f1cf350f6660 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.130255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1024-5314-46fc-815d-f1cf350f6660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.131898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-146a1024-5314-46fc-815d-f1cf350f6660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:01.249146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a1024-5314-46fc-815d-f1cf350f6660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.250811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a1024-5314-46fc-815d-f1cf350f6660 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.270004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 720/1434] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:02.106804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574838ed-5ed3-46fe-a5d2-0d3f43dd5c4e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.107739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574838ed-5ed3-46fe-a5d2-0d3f43dd5c4e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.107739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574838ed-5ed3-46fe-a5d2-0d3f43dd5c4e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.109920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:26:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:02.116202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085044e8-ac4f-48e3-bfb9-755921037b90 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.117001 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085044e8-ac4f-48e3-bfb9-755921037b90 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.117193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085044e8-ac4f-48e3-bfb9-755921037b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.209788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-085044e8-ac4f-48e3-bfb9-755921037b90 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:02.211056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-085044e8-ac4f-48e3-bfb9-755921037b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:02.267007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.328946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:02.484188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574838ed-5ed3-46fe-a5d2-0d3f43dd5c4e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.486634 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-574838ed-5ed3-46fe-a5d2-0d3f43dd5c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:02.671970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574838ed-5ed3-46fe-a5d2-0d3f43dd5c4e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.738452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.802387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9108c-3d6d-44ad-922b-70ba238e5bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.803375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9108c-3d6d-44ad-922b-70ba238e5bf1 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.803792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9108c-3d6d-44ad-922b-70ba238e5bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.804243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9108c-3d6d-44ad-922b-70ba238e5bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.806969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-22d9108c-3d6d-44ad-922b-70ba238e5bf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:03.053454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9108c-3d6d-44ad-922b-70ba238e5bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.054991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9108c-3d6d-44ad-922b-70ba238e5bf1 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.082146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 716/1437] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:03.900727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb1028-6bf9-4cc9-8017-82a45110b5f7 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.901260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb1028-6bf9-4cc9-8017-82a45110b5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.901260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb1028-6bf9-4cc9-8017-82a45110b5f7 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.904047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:03.908876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed177a-25bd-4ac8-9385-58e95b0fe8cc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.908876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed177a-25bd-4ac8-9385-58e95b0fe8cc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.908876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed177a-25bd-4ac8-9385-58e95b0fe8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.991156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1aed177a-25bd-4ac8-9385-58e95b0fe8cc None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:03.992371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1aed177a-25bd-4ac8-9385-58e95b0fe8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:03.994480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.099577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:04.258381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb1028-6bf9-4cc9-8017-82a45110b5f7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.260910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-69fb1028-6bf9-4cc9-8017-82a45110b5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:04.437629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb1028-6bf9-4cc9-8017-82a45110b5f7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.470190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.563261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eed222-0e53-407f-92a8-955c96f84410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.563826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed222-0e53-407f-92a8-955c96f84410 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.564097 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed222-0e53-407f-92a8-955c96f84410 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.564369 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed222-0e53-407f-92a8-955c96f84410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.565999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d0eed222-0e53-407f-92a8-955c96f84410 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:04.660357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eed222-0e53-407f-92a8-955c96f84410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:04.661991 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eed222-0e53-407f-92a8-955c96f84410 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:04.680701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 723/1440] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:06.523106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1c531-f810-4675-ab81-a1a84a92b96e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.523700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1c531-f810-4675-ab81-a1a84a92b96e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.523700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1c531-f810-4675-ab81-a1a84a92b96e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.525826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:06.534404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe3948-7fe3-4f62-80ba-5aa9daa4fab7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.535167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe3948-7fe3-4f62-80ba-5aa9daa4fab7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.535314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe3948-7fe3-4f62-80ba-5aa9daa4fab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.585068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:06.614072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-51fe3948-7fe3-4f62-80ba-5aa9daa4fab7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:06.615342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-51fe3948-7fe3-4f62-80ba-5aa9daa4fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:06.725491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:07.023108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1c531-f810-4675-ab81-a1a84a92b96e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.025674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-35a1c531-f810-4675-ab81-a1a84a92b96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.147736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1c531-f810-4675-ab81-a1a84a92b96e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.185460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.242421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283e501-9808-465a-83f9-238e5cfc943a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.243062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283e501-9808-465a-83f9-238e5cfc943a service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.243337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283e501-9808-465a-83f9-238e5cfc943a service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.243604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283e501-9808-465a-83f9-238e5cfc943a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.245228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9283e501-9808-465a-83f9-238e5cfc943a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.369783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283e501-9808-465a-83f9-238e5cfc943a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:07.371294 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283e501-9808-465a-83f9-238e5cfc943a service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:07.390229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 719/1443] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:09.479606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76232b-be28-455c-b6dd-6a6b604bbc67 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.480309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76232b-be28-455c-b6dd-6a6b604bbc67 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.480309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76232b-be28-455c-b6dd-6a6b604bbc67 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.481521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:09.487702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142627-1096-4944-9a98-46cd41006517 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.488196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142627-1096-4944-9a98-46cd41006517 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.488196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142627-1096-4944-9a98-46cd41006517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.571317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-32142627-1096-4944-9a98-46cd41006517 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:09.572428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-32142627-1096-4944-9a98-46cd41006517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:09.586704 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.681593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:09.965009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76232b-be28-455c-b6dd-6a6b604bbc67 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.967250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ee76232b-be28-455c-b6dd-6a6b604bbc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:10.090441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76232b-be28-455c-b6dd-6a6b604bbc67 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.109098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.174680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c44b3e-1eef-437d-8a64-0d42387c8176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.175315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c44b3e-1eef-437d-8a64-0d42387c8176 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.175593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c44b3e-1eef-437d-8a64-0d42387c8176 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.175890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c44b3e-1eef-437d-8a64-0d42387c8176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.177519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d3c44b3e-1eef-437d-8a64-0d42387c8176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:10.309816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c44b3e-1eef-437d-8a64-0d42387c8176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:10.311250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c44b3e-1eef-437d-8a64-0d42387c8176 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.335173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 726/1446] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:12.624701 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf83838-5bd5-4dd1-8e19-caa2fbb73f51 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.625232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf83838-5bd5-4dd1-8e19-caa2fbb73f51 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.625232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf83838-5bd5-4dd1-8e19-caa2fbb73f51 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.626608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:12.633223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e147-ef6d-4c9f-954d-a6eab57a3271 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.633926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e147-ef6d-4c9f-954d-a6eab57a3271 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.634125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e147-ef6d-4c9f-954d-a6eab57a3271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.689739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:12.710624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-59d0e147-ef6d-4c9f-954d-a6eab57a3271 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:12.711926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-59d0e147-ef6d-4c9f-954d-a6eab57a3271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:12.826378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:13.114607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf83838-5bd5-4dd1-8e19-caa2fbb73f51 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.117025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cbf83838-5bd5-4dd1-8e19-caa2fbb73f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:13.235128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf83838-5bd5-4dd1-8e19-caa2fbb73f51 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:13.277664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:13.327797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203d4d3-be05-4c02-99d6-696fe4d9a7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:13.328416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203d4d3-be05-4c02-99d6-696fe4d9a7cc service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.328688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203d4d3-be05-4c02-99d6-696fe4d9a7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.328950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203d4d3-be05-4c02-99d6-696fe4d9a7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.330574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8203d4d3-be05-4c02-99d6-696fe4d9a7cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:13.460158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203d4d3-be05-4c02-99d6-696fe4d9a7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:13.461609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203d4d3-be05-4c02-99d6-696fe4d9a7cc service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:13.481380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 722/1449] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:15.574011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4ca5-d165-4cb2-ab3e-f54da0e59406 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.574575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4ca5-d165-4cb2-ab3e-f54da0e59406 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.574575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4ca5-d165-4cb2-ab3e-f54da0e59406 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.576158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:15.584608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b77b2c-859b-4d0b-ba77-22d1651387c4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.585197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b77b2c-859b-4d0b-ba77-22d1651387c4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.585197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b77b2c-859b-4d0b-ba77-22d1651387c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.664046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a5b77b2c-859b-4d0b-ba77-22d1651387c4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:15.665275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a5b77b2c-859b-4d0b-ba77-22d1651387c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:15.688875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.776589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:16.072559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a4ca5-d165-4cb2-ab3e-f54da0e59406 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.075002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ab4a4ca5-d165-4cb2-ab3e-f54da0e59406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:16.186762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a4ca5-d165-4cb2-ab3e-f54da0e59406 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.210326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.267146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876325dd-7696-4d64-8ef2-de28edac99ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.267752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876325dd-7696-4d64-8ef2-de28edac99ef service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.268023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876325dd-7696-4d64-8ef2-de28edac99ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.268285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876325dd-7696-4d64-8ef2-de28edac99ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.269945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-876325dd-7696-4d64-8ef2-de28edac99ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:16.392720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876325dd-7696-4d64-8ef2-de28edac99ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.394070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876325dd-7696-4d64-8ef2-de28edac99ef service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.413895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 729/1452] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:18.464135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab0d6d-97b2-40fc-a74d-bd9ce534db0d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.464784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab0d6d-97b2-40fc-a74d-bd9ce534db0d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.464784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab0d6d-97b2-40fc-a74d-bd9ce534db0d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.466023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:18.471821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c820c-e2eb-41fd-bc05-b5784c643e27 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.472307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c820c-e2eb-41fd-bc05-b5784c643e27 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.472416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c820c-e2eb-41fd-bc05-b5784c643e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.551767 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.554690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e59c820c-e2eb-41fd-bc05-b5784c643e27 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:18.556830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e59c820c-e2eb-41fd-bc05-b5784c643e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:18.657019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:18.946866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab0d6d-97b2-40fc-a74d-bd9ce534db0d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.948431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4aab0d6d-97b2-40fc-a74d-bd9ce534db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:19.065209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab0d6d-97b2-40fc-a74d-bd9ce534db0d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.116187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.143963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cb8be-81c6-4577-9987-a903af7c520e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.144568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb8be-81c6-4577-9987-a903af7c520e service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.144833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb8be-81c6-4577-9987-a903af7c520e service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.145177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb8be-81c6-4577-9987-a903af7c520e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.146713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-555cb8be-81c6-4577-9987-a903af7c520e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:19.266796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cb8be-81c6-4577-9987-a903af7c520e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.268156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cb8be-81c6-4577-9987-a903af7c520e service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.286361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 725/1455] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:26:21.261839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b89f1-a812-499e-94a9-203db4a2a799 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.262616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b89f1-a812-499e-94a9-203db4a2a799 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.262861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b89f1-a812-499e-94a9-203db4a2a799 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.265126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:21.270864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc6fa-0176-45d1-957b-e2136f741432 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.271340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc6fa-0176-45d1-957b-e2136f741432 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.271450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc6fa-0176-45d1-957b-e2136f741432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.354694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-13cfc6fa-0176-45d1-957b-e2136f741432 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:21.356438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-13cfc6fa-0176-45d1-957b-e2136f741432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:21.388235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.462769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:21.748459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b89f1-a812-499e-94a9-203db4a2a799 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.750158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bf8b89f1-a812-499e-94a9-203db4a2a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:21.863017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b89f1-a812-499e-94a9-203db4a2a799 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.894637 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.956252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0ee56-e39d-4bab-8f9a-b7642e6ce20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.956869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ee56-e39d-4bab-8f9a-b7642e6ce20f service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.957144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ee56-e39d-4bab-8f9a-b7642e6ce20f service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.957412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ee56-e39d-4bab-8f9a-b7642e6ce20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.959087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bed0ee56-e39d-4bab-8f9a-b7642e6ce20f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:22.078884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0ee56-e39d-4bab-8f9a-b7642e6ce20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.080247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0ee56-e39d-4bab-8f9a-b7642e6ce20f service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.099024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 732/1458] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:26:24.121926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdabb3e-6b1c-4b2a-9263-1bc6c6a5464a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.122849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdabb3e-6b1c-4b2a-9263-1bc6c6a5464a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.122849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdabb3e-6b1c-4b2a-9263-1bc6c6a5464a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.125607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:24.131553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db848-c7fc-46a8-9e54-071c737229fa None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.132153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db848-c7fc-46a8-9e54-071c737229fa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.132153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db848-c7fc-46a8-9e54-071c737229fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.222645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b29db848-c7fc-46a8-9e54-071c737229fa None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:24.223914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b29db848-c7fc-46a8-9e54-071c737229fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:24.232543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.355456 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:24.655818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdabb3e-6b1c-4b2a-9263-1bc6c6a5464a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.657447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6fdabb3e-6b1c-4b2a-9263-1bc6c6a5464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:24.811211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdabb3e-6b1c-4b2a-9263-1bc6c6a5464a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.888552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.914870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd512aa-585d-4d6e-a92b-ee85f3470b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.915492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd512aa-585d-4d6e-a92b-ee85f3470b6f service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.915764 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd512aa-585d-4d6e-a92b-ee85f3470b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.916033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd512aa-585d-4d6e-a92b-ee85f3470b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.917772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9dd512aa-585d-4d6e-a92b-ee85f3470b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:25.058141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd512aa-585d-4d6e-a92b-ee85f3470b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.059630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd512aa-585d-4d6e-a92b-ee85f3470b6f service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.083695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 728/1461] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:27.085437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6df8-8a1b-418b-9a8e-74bbe095ae41 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.086057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6df8-8a1b-418b-9a8e-74bbe095ae41 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.086057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6df8-8a1b-418b-9a8e-74bbe095ae41 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.087520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:27.095577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679e62-42fd-4254-b9dc-868c9ff79e9a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.096035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679e62-42fd-4254-b9dc-868c9ff79e9a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.096145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679e62-42fd-4254-b9dc-868c9ff79e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.175672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-57679e62-42fd-4254-b9dc-868c9ff79e9a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:27.176976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-57679e62-42fd-4254-b9dc-868c9ff79e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:27.219238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.288658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:27.588229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6df8-8a1b-418b-9a8e-74bbe095ae41 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.589867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b08d6df8-8a1b-418b-9a8e-74bbe095ae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:27.717294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6df8-8a1b-418b-9a8e-74bbe095ae41 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.776053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.820169 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c01ee0-2f28-4f9f-8034-775030d52801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.820779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01ee0-2f28-4f9f-8034-775030d52801 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.821049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01ee0-2f28-4f9f-8034-775030d52801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.821309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01ee0-2f28-4f9f-8034-775030d52801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.822924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-91c01ee0-2f28-4f9f-8034-775030d52801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:27.943974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c01ee0-2f28-4f9f-8034-775030d52801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.945409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c01ee0-2f28-4f9f-8034-775030d52801 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.967892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 735/1464] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:29.902773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807bcf-27d0-4a83-a656-d2fd7869e32b None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.903351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807bcf-27d0-4a83-a656-d2fd7869e32b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.903351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807bcf-27d0-4a83-a656-d2fd7869e32b None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.904571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:29.911185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88abc15-1cbf-476d-80d6-7005bb32c004 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.911904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88abc15-1cbf-476d-80d6-7005bb32c004 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.912067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88abc15-1cbf-476d-80d6-7005bb32c004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.993241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b88abc15-1cbf-476d-80d6-7005bb32c004 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:29.994454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b88abc15-1cbf-476d-80d6-7005bb32c004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:30.013740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.100998 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:30.391737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807bcf-27d0-4a83-a656-d2fd7869e32b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.394110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3a807bcf-27d0-4a83-a656-d2fd7869e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:30.523406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807bcf-27d0-4a83-a656-d2fd7869e32b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.602818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.610427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6da6d-056a-4d53-8ade-bffed715dbc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.611084 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6da6d-056a-4d53-8ade-bffed715dbc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.611352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6da6d-056a-4d53-8ade-bffed715dbc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.611594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6da6d-056a-4d53-8ade-bffed715dbc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.613240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-beb6da6d-056a-4d53-8ade-bffed715dbc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:30.727469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6da6d-056a-4d53-8ade-bffed715dbc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.728906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6da6d-056a-4d53-8ade-bffed715dbc2 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.747758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 731/1467] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:32.693289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac6df-7a12-4736-8d6e-579cb6d96893 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.694219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac6df-7a12-4736-8d6e-579cb6d96893 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.694219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac6df-7a12-4736-8d6e-579cb6d96893 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.696131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:32.702693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116653b-9614-4dfe-aa2a-5cb2bdddffe6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.703173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116653b-9614-4dfe-aa2a-5cb2bdddffe6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.703279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116653b-9614-4dfe-aa2a-5cb2bdddffe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.776483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5116653b-9614-4dfe-aa2a-5cb2bdddffe6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:32.777714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5116653b-9614-4dfe-aa2a-5cb2bdddffe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:32.828926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.883632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:33.172946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac6df-7a12-4736-8d6e-579cb6d96893 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:33.175407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fa0ac6df-7a12-4736-8d6e-579cb6d96893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:33.304116 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac6df-7a12-4736-8d6e-579cb6d96893 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:33.353710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:33.382243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e279113-dbfc-4029-84c3-11bbebb6d30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:33.382893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279113-dbfc-4029-84c3-11bbebb6d30b service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.383171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279113-dbfc-4029-84c3-11bbebb6d30b service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.383440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279113-dbfc-4029-84c3-11bbebb6d30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.385057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5e279113-dbfc-4029-84c3-11bbebb6d30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:33.524536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e279113-dbfc-4029-84c3-11bbebb6d30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:33.525997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e279113-dbfc-4029-84c3-11bbebb6d30b service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:33.545582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 738/1470] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:42.881699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=22 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.542786 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=66 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.377648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231501b-e322-4fdc-b2d2-8b59a23a2ffc None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.378255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231501b-e322-4fdc-b2d2-8b59a23a2ffc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.378255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231501b-e322-4fdc-b2d2-8b59a23a2ffc None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.379697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 733/1471] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:53.386263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c6480-54dc-4600-92aa-3c96d9a2f2ab None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.386727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c6480-54dc-4600-92aa-3c96d9a2f2ab None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.387032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c6480-54dc-4600-92aa-3c96d9a2f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.465841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-670c6480-54dc-4600-92aa-3c96d9a2f2ab None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:53.467150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-670c6480-54dc-4600-92aa-3c96d9a2f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:53.588386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 739/1472] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:53.895711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f330a2c-17a6-4ee7-9374-524df8cdb69f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.895973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f330a2c-17a6-4ee7-9374-524df8cdb69f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.896271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f330a2c-17a6-4ee7-9374-524df8cdb69f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.898293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 734/1473] 10.222.0.78 () {54 vars in 967 bytes} [Wed Aug 24 03:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:53.903554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e180bc-ca8c-42f7-bad9-3ea77669b33d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.903867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e180bc-ca8c-42f7-bad9-3ea77669b33d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.904149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e180bc-ca8c-42f7-bad9-3ea77669b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.006033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-11e180bc-ca8c-42f7-bad9-3ea77669b33d None None] MFA Rules not processed for user `d6c0b33c2c7947c59ebf8da17abbd0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:54.007315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-11e180bc-ca8c-42f7-bad9-3ea77669b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:54.031029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.092117 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 740/1474] 10.222.0.78 () {58 vars in 1064 bytes} [Wed Aug 24 03:26:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:26:54.103416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f330a2c-17a6-4ee7-9374-524df8cdb69f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.105755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0f330a2c-17a6-4ee7-9374-524df8cdb69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:54.222444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f330a2c-17a6-4ee7-9374-524df8cdb69f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.304902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad058e74-33ad-4ab6-a3c2-d1a6c6c63a8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c0b33c2c7947c59ebf8da17abbd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.305512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad058e74-33ad-4ab6-a3c2-d1a6c6c63a8e service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.305785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad058e74-33ad-4ab6-a3c2-d1a6c6c63a8e service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.306048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad058e74-33ad-4ab6-a3c2-d1a6c6c63a8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.307735 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ad058e74-33ad-4ab6-a3c2-d1a6c6c63a8e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:54.367838 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.426342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad058e74-33ad-4ab6-a3c2-d1a6c6c63a8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.427824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad058e74-33ad-4ab6-a3c2-d1a6c6c63a8e service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.455917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 735/1475] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:26:56.456645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29302ca0-7b2b-432f-b102-e0dce20036bf None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.457557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29302ca0-7b2b-432f-b102-e0dce20036bf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.457557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29302ca0-7b2b-432f-b102-e0dce20036bf None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.459715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 741/1476] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:56.465682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671786b-48d3-49c4-90d2-fa7d7746fa1d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.466156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671786b-48d3-49c4-90d2-fa7d7746fa1d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.466156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671786b-48d3-49c4-90d2-fa7d7746fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.547320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1671786b-48d3-49c4-90d2-fa7d7746fa1d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:56.548577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1671786b-48d3-49c4-90d2-fa7d7746fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:56.663463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 736/1477] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:56.939025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29302ca0-7b2b-432f-b102-e0dce20036bf None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.940578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-29302ca0-7b2b-432f-b102-e0dce20036bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:57.086672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29302ca0-7b2b-432f-b102-e0dce20036bf None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.140462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.193486 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141632a-2dc2-44b3-ad25-712536dfc253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.193961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141632a-2dc2-44b3-ad25-712536dfc253 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.194225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141632a-2dc2-44b3-ad25-712536dfc253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.194484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141632a-2dc2-44b3-ad25-712536dfc253 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.195156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141632a-2dc2-44b3-ad25-712536dfc253 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.196969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-1141632a-2dc2-44b3-ad25-712536dfc253 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:26:57.196969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 03:26:57.196969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: Aug 24 03:26:57.198108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141632a-2dc2-44b3-ad25-712536dfc253 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.218562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 742/1478] 10.222.0.78 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/projects => generated 2553 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:26:59.163415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e448da-88d8-4f57-ac19-a2ef4140a892 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.164002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e448da-88d8-4f57-ac19-a2ef4140a892 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.164002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e448da-88d8-4f57-ac19-a2ef4140a892 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.165941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 737/1479] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:26:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:59.171534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb94d1-b21c-4b61-9a99-16add1ef7d45 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.171994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb94d1-b21c-4b61-9a99-16add1ef7d45 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.172108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb94d1-b21c-4b61-9a99-16add1ef7d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.243665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f8fb94d1-b21c-4b61-9a99-16add1ef7d45 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:59.244911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f8fb94d1-b21c-4b61-9a99-16add1ef7d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:59.363007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 743/1480] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:26:59.659946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e448da-88d8-4f57-ac19-a2ef4140a892 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.661589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-08e448da-88d8-4f57-ac19-a2ef4140a892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:59.674695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.824275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e448da-88d8-4f57-ac19-a2ef4140a892 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.921337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.956871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d4c3a-1ba3-41db-8227-cdf21794eac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.957488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4c3a-1ba3-41db-8227-cdf21794eac5 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.957760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4c3a-1ba3-41db-8227-cdf21794eac5 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.958026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4c3a-1ba3-41db-8227-cdf21794eac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.959685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-005d4c3a-1ba3-41db-8227-cdf21794eac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:00.058816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d4c3a-1ba3-41db-8227-cdf21794eac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.061656 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d4c3a-1ba3-41db-8227-cdf21794eac5 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.086292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 738/1481] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:27:02.244820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb984b-e334-41af-b400-8cede5d994f8 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.245694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb984b-e334-41af-b400-8cede5d994f8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.245694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb984b-e334-41af-b400-8cede5d994f8 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.248118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 744/1482] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:02.254181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b90ab3-0fb7-42d8-a5fa-0e32e85dbc1d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.254618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b90ab3-0fb7-42d8-a5fa-0e32e85dbc1d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.254755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b90ab3-0fb7-42d8-a5fa-0e32e85dbc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.337368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-64b90ab3-0fb7-42d8-a5fa-0e32e85dbc1d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:02.339410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-64b90ab3-0fb7-42d8-a5fa-0e32e85dbc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:02.390353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.455223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 739/1483] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:27:02.749216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb984b-e334-41af-b400-8cede5d994f8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.751726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b6bb984b-e334-41af-b400-8cede5d994f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:02.781534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.868358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb984b-e334-41af-b400-8cede5d994f8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.946502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523938-4eb3-4d21-8105-7c8059f5d0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.947162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523938-4eb3-4d21-8105-7c8059f5d0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.947448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523938-4eb3-4d21-8105-7c8059f5d0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.947708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523938-4eb3-4d21-8105-7c8059f5d0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.949331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-07523938-4eb3-4d21-8105-7c8059f5d0d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:03.033504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.078740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523938-4eb3-4d21-8105-7c8059f5d0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.080207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523938-4eb3-4d21-8105-7c8059f5d0d6 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.099804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 745/1484] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:27:05.100611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319838fc-9438-47f7-be8c-eb45107f2aa1 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.101218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319838fc-9438-47f7-be8c-eb45107f2aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.101218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319838fc-9438-47f7-be8c-eb45107f2aa1 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.102512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 740/1485] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:05.109501 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114904-a1b7-47b2-b5b6-606c21734eaa None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.109959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114904-a1b7-47b2-b5b6-606c21734eaa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.110063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114904-a1b7-47b2-b5b6-606c21734eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.185085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d4114904-a1b7-47b2-b5b6-606c21734eaa None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:05.186383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d4114904-a1b7-47b2-b5b6-606c21734eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:05.306906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 746/1486] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:27:05.593929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319838fc-9438-47f7-be8c-eb45107f2aa1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.596831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-319838fc-9438-47f7-be8c-eb45107f2aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:05.724618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319838fc-9438-47f7-be8c-eb45107f2aa1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.813413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.815241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bc7e2-f5d5-4761-9bf9-a679a258f24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.815860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bc7e2-f5d5-4761-9bf9-a679a258f24b service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.816388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bc7e2-f5d5-4761-9bf9-a679a258f24b service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.816972 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bc7e2-f5d5-4761-9bf9-a679a258f24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.819368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-311bc7e2-f5d5-4761-9bf9-a679a258f24b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:05.957497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bc7e2-f5d5-4761-9bf9-a679a258f24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.958984 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bc7e2-f5d5-4761-9bf9-a679a258f24b service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.978202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 741/1487] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:27:08.073177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fc3dd-2b10-45ba-99af-f9c341cfc23a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.073766 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fc3dd-2b10-45ba-99af-f9c341cfc23a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.073766 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fc3dd-2b10-45ba-99af-f9c341cfc23a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.075167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 747/1488] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:08.081318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187b80b-acb9-4c6f-a5e6-6c6f6f1ffa7d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.081785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187b80b-acb9-4c6f-a5e6-6c6f6f1ffa7d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.081890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187b80b-acb9-4c6f-a5e6-6c6f6f1ffa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.163169 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c187b80b-acb9-4c6f-a5e6-6c6f6f1ffa7d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:08.164401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c187b80b-acb9-4c6f-a5e6-6c6f6f1ffa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:08.233678 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.286759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 742/1489] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:27:08.591911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fc3dd-2b10-45ba-99af-f9c341cfc23a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.593818 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e6fc3dd-2b10-45ba-99af-f9c341cfc23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:08.640553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.715149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fc3dd-2b10-45ba-99af-f9c341cfc23a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.804236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34968d2e-6451-4dae-9606-495770f9b0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.804851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34968d2e-6451-4dae-9606-495770f9b0bc service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.805150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34968d2e-6451-4dae-9606-495770f9b0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.805409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34968d2e-6451-4dae-9606-495770f9b0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.807104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-34968d2e-6451-4dae-9606-495770f9b0bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:08.894543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.931678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34968d2e-6451-4dae-9606-495770f9b0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.933847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34968d2e-6451-4dae-9606-495770f9b0bc service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.955667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 748/1490] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:27:11.147723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85acc2-527e-4e64-9cf9-53373b0d2b18 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.148349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85acc2-527e-4e64-9cf9-53373b0d2b18 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.148349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85acc2-527e-4e64-9cf9-53373b0d2b18 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.150197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 743/1491] 10.222.0.78 () {54 vars in 927 bytes} [Wed Aug 24 03:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:11.157442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a62cfe-3229-4c1d-92b8-f8438c756dfb None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.157911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a62cfe-3229-4c1d-92b8-f8438c756dfb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.158015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a62cfe-3229-4c1d-92b8-f8438c756dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.227745 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-59a62cfe-3229-4c1d-92b8-f8438c756dfb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:11.228946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-59a62cfe-3229-4c1d-92b8-f8438c756dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:11.348980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 749/1492] 10.222.0.78 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:27:11.693920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85acc2-527e-4e64-9cf9-53373b0d2b18 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.695520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3f85acc2-527e-4e64-9cf9-53373b0d2b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:11.830001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85acc2-527e-4e64-9cf9-53373b0d2b18 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.909667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499a930-b0ee-451d-b63d-bfc0c027c8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.910189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499a930-b0ee-451d-b63d-bfc0c027c8ea service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.910466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499a930-b0ee-451d-b63d-bfc0c027c8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.910772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499a930-b0ee-451d-b63d-bfc0c027c8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.912387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d499a930-b0ee-451d-b63d-bfc0c027c8ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:11.923760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.034499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499a930-b0ee-451d-b63d-bfc0c027c8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.035974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499a930-b0ee-451d-b63d-bfc0c027c8ea service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.054586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 744/1493] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:27:21.342478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=82 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.053800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=50 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:28.664436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f99f-4c1c-468f-b034-d673658b1557 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:28.665333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f99f-4c1c-468f-b034-d673658b1557 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:28.665333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f99f-4c1c-468f-b034-d673658b1557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:28.761373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f945f99f-4c1c-468f-b034-d673658b1557 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:28.763273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f945f99f-4c1c-468f-b034-d673658b1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:29.019005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 750/1494] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:28:29.029925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd2517-4cb2-4a2f-be45-f015a09192aa None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:29.030828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd2517-4cb2-4a2f-be45-f015a09192aa None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:29.030828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd2517-4cb2-4a2f-be45-f015a09192aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:29.133674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-42dd2517-4cb2-4a2f-be45-f015a09192aa None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:29.134980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-42dd2517-4cb2-4a2f-be45-f015a09192aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:29.262105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 745/1495] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:28:29.268517 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945f99f-4c1c-468f-b034-d673658b1557 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:29.270429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f945f99f-4c1c-468f-b034-d673658b1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:29.287022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945f99f-4c1c-468f-b034-d673658b1557 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:29.365211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:29.403320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:29.403934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:29.404204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:29.404489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:29.405113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:29.405460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:29.406460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:29.406460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 03:28:29.406460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: Aug 24 03:28:29.407398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:29.419692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 751/1496] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:29.428722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd2517-4cb2-4a2f-be45-f015a09192aa None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:29.439271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd2517-4cb2-4a2f-be45-f015a09192aa None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:29.507055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:29.544826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:29.545341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:29.545619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:29.545884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:29.546514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:29.548317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:29.548317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 03:28:29.548317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: Aug 24 03:28:29.549510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:29.617138 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 746/1497] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:28:29 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:29.621523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:29.623107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:29.658667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9a0a8-d6a7-4b3d-abb9-b9d6fd5d8dcb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:29.759195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:29.759943 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:29.760050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:29.760320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:29.760942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:29.762032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:29.762032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 03:28:29.762032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: Aug 24 03:28:29.763303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:29.823293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 752/1498] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:28:29 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:29.828937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:29.830504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:29.897961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85a5d6-9896-4375-a7db-89c4c044e6f3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:29.987451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:29.999417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:30.000053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.000326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.000566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.001200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:30.002235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:30.002235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 03:28:30.002235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: Aug 24 03:28:30.003149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:30.016285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 747/1499] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:28:30.020632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:30.022159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:30.034293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3a032-11f1-4adc-93b3-7d93eb26f7b4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:30.065830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:30.142890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff2d06-bd9d-4d4e-a614-67ec09d8a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:30.143496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff2d06-bd9d-4d4e-a614-67ec09d8a1de admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.143764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff2d06-bd9d-4d4e-a614-67ec09d8a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.144030 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff2d06-bd9d-4d4e-a614-67ec09d8a1de admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.144673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff2d06-bd9d-4d4e-a614-67ec09d8a1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:30.145691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-e8ff2d06-bd9d-4d4e-a614-67ec09d8a1de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:30.145691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 03:28:30.145691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: Aug 24 03:28:30.146555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff2d06-bd9d-4d4e-a614-67ec09d8a1de admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:30.160007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 753/1500] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:28:30.164643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:30.166253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:30.209652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c30beb-a47b-4f7b-894f-2f5f80c9cea1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:30.316807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c7844-300b-482f-abe6-7660f3d65d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:30.317467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7844-300b-482f-abe6-7660f3d65d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.317742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7844-300b-482f-abe6-7660f3d65d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.318013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7844-300b-482f-abe6-7660f3d65d77 admin admin] PATH_INFO: `/v3/projects/46f8965022314e189da209fb6a4cc16c/users/345fec9853df4a14a0d814e90fc85078/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.342519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7844-300b-482f-abe6-7660f3d65d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f8965022314e189da209fb6a4cc16c, user_id=345fec9853df4a14a0d814e90fc85078, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:30.343617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-c01c7844-300b-482f-abe6-7660f3d65d77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:30.343617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 03:28:30.343617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: Aug 24 03:28:30.345526 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7844-300b-482f-abe6-7660f3d65d77 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:30.374086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 748/1501] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:28:30 2022] PUT /identity/v3/projects/46f8965022314e189da209fb6a4cc16c/users/345fec9853df4a14a0d814e90fc85078/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:28:30.387211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbdb8d-2bda-4892-8d40-c01d5b77e731 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.387575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbdb8d-2bda-4892-8d40-c01d5b77e731 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.387828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbdb8d-2bda-4892-8d40-c01d5b77e731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.465708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-90bbdb8d-2bda-4892-8d40-c01d5b77e731 None None] MFA Rules not processed for user `345fec9853df4a14a0d814e90fc85078`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:30.466993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-90bbdb8d-2bda-4892-8d40-c01d5b77e731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:30.558313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 754/1502] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:28:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:28:30.573488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4ab8f-5deb-4a26-b0a5-78389420a9e7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.573794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4ab8f-5deb-4a26-b0a5-78389420a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.574196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4ab8f-5deb-4a26-b0a5-78389420a9e7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.576112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 749/1503] 10.222.0.78 () {54 vars in 964 bytes} [Wed Aug 24 03:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:30.581150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c99b3-cbe7-465f-b34d-b1585a315cd8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.581438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c99b3-cbe7-465f-b34d-b1585a315cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.581706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c99b3-cbe7-465f-b34d-b1585a315cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.622158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:30.669938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-126c99b3-cbe7-465f-b34d-b1585a315cd8 None None] MFA Rules not processed for user `e736e983399140c2a7e6ee2c9e297021`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:30.671106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-126c99b3-cbe7-465f-b34d-b1585a315cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:30.754505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 755/1504] 10.222.0.78 () {58 vars in 1061 bytes} [Wed Aug 24 03:28:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:28:30.762637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4ab8f-5deb-4a26-b0a5-78389420a9e7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:30.764220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2ee4ab8f-5deb-4a26-b0a5-78389420a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:30.822246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:30.879694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4ab8f-5deb-4a26-b0a5-78389420a9e7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:30.963614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:30.964517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.964795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.965062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.967735 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:31.085829 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:31.087319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:31.091263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.114047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 750/1505] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:28:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:28:31.169538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26271f-c184-48c4-88f5-58d8b6c138ba None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.170028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26271f-c184-48c4-88f5-58d8b6c138ba None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.170136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26271f-c184-48c4-88f5-58d8b6c138ba None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.171979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 756/1506] 10.222.0.78 () {52 vars in 830 bytes} [Wed Aug 24 03:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:31.176014 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.177277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:31.284553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c496f-5229-4c54-a321-2dc3ab3b8e52 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.392560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.393287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.393561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.393827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] PATH_INFO: `/v3/users/345fec9853df4a14a0d814e90fc85078` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.408247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] RBAC: Authorizing `identity:delete_user(user_id=345fec9853df4a14a0d814e90fc85078)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:31.409285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:31.409285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 03:28:31.409285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: Aug 24 03:28:31.410503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:31.422168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.495267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345fec9853df4a14a0d814e90fc85078'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:31.495918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345fec9853df4a14a0d814e90fc85078'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:31.523103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345fec9853df4a14a0d814e90fc85078'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:31.535867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345fec9853df4a14a0d814e90fc85078'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:31.552513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345fec9853df4a14a0d814e90fc85078'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:31.558945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 751/1507] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:28:31 2022] DELETE /identity/v3/users/345fec9853df4a14a0d814e90fc85078 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:28:31.563566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0cda1-0b9f-495d-be23-bdbc9d0e7ea4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.563852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0cda1-0b9f-495d-be23-bdbc9d0e7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.564127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0cda1-0b9f-495d-be23-bdbc9d0e7ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.625725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-61c0cda1-0b9f-495d-be23-bdbc9d0e7ea4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:31.627005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-61c0cda1-0b9f-495d-be23-bdbc9d0e7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:31.709107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.722718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 757/1508] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:28:31.733252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.735181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:31.854491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a069282-b978-45d8-a9d8-0fb938ed862e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.914678 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.938119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664fc62-7a8f-43e6-a4f7-54d9ded2bb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.938803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664fc62-7a8f-43e6-a4f7-54d9ded2bb1e service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.939058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664fc62-7a8f-43e6-a4f7-54d9ded2bb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.939319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664fc62-7a8f-43e6-a4f7-54d9ded2bb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.940905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b664fc62-7a8f-43e6-a4f7-54d9ded2bb1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:32.085788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664fc62-7a8f-43e6-a4f7-54d9ded2bb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:32.087287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664fc62-7a8f-43e6-a4f7-54d9ded2bb1e service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:32.107106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 752/1509] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:28:32.473420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0cda1-0b9f-495d-be23-bdbc9d0e7ea4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:32.474691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-61c0cda1-0b9f-495d-be23-bdbc9d0e7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:32.488231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0cda1-0b9f-495d-be23-bdbc9d0e7ea4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:32.604530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:32.605167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:32.605440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:32.606231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] PATH_INFO: `/v3/projects/46f8965022314e189da209fb6a4cc16c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:32.616768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f8965022314e189da209fb6a4cc16c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:32.617808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:32.617808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 03:28:32.617808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: Aug 24 03:28:32.619040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:32.683196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f8965022314e189da209fb6a4cc16c', 'request_id': 'req-751d103a-5797-47a7-b0c8-b0f9afc32136'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:32.701088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f8965022314e189da209fb6a4cc16c', 'request_id': 'req-751d103a-5797-47a7-b0c8-b0f9afc32136'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:32.708866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f8965022314e189da209fb6a4cc16c', 'request_id': 'req-751d103a-5797-47a7-b0c8-b0f9afc32136'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:32.737555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] The token cache is being invalidate because project 46f8965022314e189da209fb6a4cc16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:28:32.737792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:32.738163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-751d103a-5797-47a7-b0c8-b0f9afc32136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:28:32.739619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 758/1510] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:28:32 2022] DELETE /identity/v3/projects/46f8965022314e189da209fb6a4cc16c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:28:42.104338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=62 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:42.735574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:14.756285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595b7f-e4ed-4217-b82e-60e0d4c6c9f7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:14.756992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595b7f-e4ed-4217-b82e-60e0d4c6c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:14.756992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595b7f-e4ed-4217-b82e-60e0d4c6c9f7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:14.758241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:14.764494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcdbde-136c-48cd-b869-fc69dfa97e19 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:14.765404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcdbde-136c-48cd-b869-fc69dfa97e19 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:14.765404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcdbde-136c-48cd-b869-fc69dfa97e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:14.884228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1dbcdbde-136c-48cd-b869-fc69dfa97e19 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:14.885481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1dbcdbde-136c-48cd-b869-fc69dfa97e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:15.020598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:30:15.188194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595b7f-e4ed-4217-b82e-60e0d4c6c9f7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:15.193762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-77595b7f-e4ed-4217-b82e-60e0d4c6c9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:15.335802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595b7f-e4ed-4217-b82e-60e0d4c6c9f7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:15.342325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4674cf3-9d8e-4d32-add9-e04980d8f7a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:15.343045 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674cf3-9d8e-4d32-add9-e04980d8f7a2 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:15.343363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674cf3-9d8e-4d32-add9-e04980d8f7a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:15.343710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674cf3-9d8e-4d32-add9-e04980d8f7a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.355703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4674cf3-9d8e-4d32-add9-e04980d8f7a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:15.357508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4674cf3-9d8e-4d32-add9-e04980d8f7a2 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:15.368948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 754/1513] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:16.289726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c98b5-8ec8-42bd-b6c0-9902be83d0bc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.290407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c98b5-8ec8-42bd-b6c0-9902be83d0bc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.290407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c98b5-8ec8-42bd-b6c0-9902be83d0bc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.291801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:16.298275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14164b-253a-4393-a59c-e20769d46c60 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.299180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14164b-253a-4393-a59c-e20769d46c60 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.299180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14164b-253a-4393-a59c-e20769d46c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.323828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-af14164b-253a-4393-a59c-e20769d46c60 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:16.323828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-af14164b-253a-4393-a59c-e20769d46c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:16.333135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:30:16.412569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb860-06f7-4228-ab0d-3a9a69296956 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.412833 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb860-06f7-4228-ab0d-3a9a69296956 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.413129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb860-06f7-4228-ab0d-3a9a69296956 None None] PATH_INFO: `/v3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.414452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 761/1516] 10.222.0.79 () {54 vars in 925 bytes} [Wed Aug 24 03:30:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:16.421869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc6d1-be95-41c8-9e1a-328f1b244c6e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.422325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc6d1-be95-41c8-9e1a-328f1b244c6e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.422832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc6d1-be95-41c8-9e1a-328f1b244c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.491515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beb860-06f7-4228-ab0d-3a9a69296956 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:16.509350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beb860-06f7-4228-ab0d-3a9a69296956 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:16.516459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedd2f6-7cce-4791-85ec-58a47feb8e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:16.517124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedd2f6-7cce-4791-85ec-58a47feb8e7a service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.517459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedd2f6-7cce-4791-85ec-58a47feb8e7a service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.517698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedd2f6-7cce-4791-85ec-58a47feb8e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.522243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-844fc6d1-be95-41c8-9e1a-328f1b244c6e None None] MFA Rules not processed for user `496b8b8fa8ad4cc59b7f3d2c48cdd977`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:16.523888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-844fc6d1-be95-41c8-9e1a-328f1b244c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:16.527594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedd2f6-7cce-4791-85ec-58a47feb8e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:16.529287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedd2f6-7cce-4791-85ec-58a47feb8e7a service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:16.545355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 762/1517] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:30:16.627270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:16.655960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 756/1518] 10.222.0.79 () {58 vars in 1015 bytes} [Wed Aug 24 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:30:26.535622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=75 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:26.651425 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:27.258110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ca3d4-4ab5-4a70-8f75-2dd85b8f96c4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:27.258429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ca3d4-4ab5-4a70-8f75-2dd85b8f96c4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:27.258921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ca3d4-4ab5-4a70-8f75-2dd85b8f96c4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:27.260630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 763/1519] 10.222.0.78 () {54 vars in 961 bytes} [Wed Aug 24 03:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:27.267991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29f060-063d-4329-8778-6b0e44487bb0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:27.268596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29f060-063d-4329-8778-6b0e44487bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:27.269136 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29f060-063d-4329-8778-6b0e44487bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:27.305257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9e29f060-063d-4329-8778-6b0e44487bb0 None None] MFA Rules not processed for user `496b8b8fa8ad4cc59b7f3d2c48cdd977`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:27.307458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9e29f060-063d-4329-8778-6b0e44487bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:27.321176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 757/1520] 10.222.0.78 () {58 vars in 1058 bytes} [Wed Aug 24 03:30:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:30:27.329923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ca3d4-4ab5-4a70-8f75-2dd85b8f96c4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:27.346554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ca3d4-4ab5-4a70-8f75-2dd85b8f96c4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:27.352890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ae7d-bd2c-4ae7-aa65-7b47d908e28d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:27.353850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ae7d-bd2c-4ae7-aa65-7b47d908e28d service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:27.354331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ae7d-bd2c-4ae7-aa65-7b47d908e28d service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:27.354960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ae7d-bd2c-4ae7-aa65-7b47d908e28d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:27.371516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29ae7d-bd2c-4ae7-aa65-7b47d908e28d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:27.374129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29ae7d-bd2c-4ae7-aa65-7b47d908e28d service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:27.394202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 764/1521] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:30:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:28.075061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c3f1-878b-4d7a-b308-c406fa6423e5 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:28.075846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c3f1-878b-4d7a-b308-c406fa6423e5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:28.075846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c3f1-878b-4d7a-b308-c406fa6423e5 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:28.077242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:28.082976 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dcc03-5a55-49c4-bdd7-e8a6344e01d1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:28.083824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dcc03-5a55-49c4-bdd7-e8a6344e01d1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:28.083824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dcc03-5a55-49c4-bdd7-e8a6344e01d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:28.108986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b81dcc03-5a55-49c4-bdd7-e8a6344e01d1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:28.110706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b81dcc03-5a55-49c4-bdd7-e8a6344e01d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:28.123855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:30:28.292327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335c3f1-878b-4d7a-b308-c406fa6423e5 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:28.315027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335c3f1-878b-4d7a-b308-c406fa6423e5 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:28.325670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fde422-122f-4c89-9f6d-2f1bba817311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:28.326408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fde422-122f-4c89-9f6d-2f1bba817311 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:28.326588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fde422-122f-4c89-9f6d-2f1bba817311 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:28.326878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fde422-122f-4c89-9f6d-2f1bba817311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:28.336815 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fde422-122f-4c89-9f6d-2f1bba817311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:28.341718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fde422-122f-4c89-9f6d-2f1bba817311 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:28.365680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 759/1524] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:29.247414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974261d9-eb6a-4245-8fdc-4eb67511f73c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:29.248260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974261d9-eb6a-4245-8fdc-4eb67511f73c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:29.248260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974261d9-eb6a-4245-8fdc-4eb67511f73c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:29.249364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:29.258170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef536df-de05-496d-9910-9381d89122ce None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:29.258842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef536df-de05-496d-9910-9381d89122ce None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:29.259148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef536df-de05-496d-9910-9381d89122ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:29.289812 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9ef536df-de05-496d-9910-9381d89122ce None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:29.291143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9ef536df-de05-496d-9910-9381d89122ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:29.304606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:30:29.464257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974261d9-eb6a-4245-8fdc-4eb67511f73c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:29.482997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974261d9-eb6a-4245-8fdc-4eb67511f73c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:29.494451 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d3d64-128d-41c1-a555-accf6264b17a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:29.496152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3d64-128d-41c1-a555-accf6264b17a service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:29.496710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3d64-128d-41c1-a555-accf6264b17a service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:29.497275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3d64-128d-41c1-a555-accf6264b17a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:29.510600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d3d64-128d-41c1-a555-accf6264b17a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:29.514591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d3d64-128d-41c1-a555-accf6264b17a service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:29.531016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 767/1527] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:33.861755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a336c-7fbc-4ab1-8f67-796fd6b2c124 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:33.862597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a336c-7fbc-4ab1-8f67-796fd6b2c124 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:33.862597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a336c-7fbc-4ab1-8f67-796fd6b2c124 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:33.863758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:33.870791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c0b9f-6735-40b4-8e6e-714328094126 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:33.871395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c0b9f-6735-40b4-8e6e-714328094126 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:33.871669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c0b9f-6735-40b4-8e6e-714328094126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:33.898455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-394c0b9f-6735-40b4-8e6e-714328094126 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:33.899764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-394c0b9f-6735-40b4-8e6e-714328094126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:33.912707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:30:34.235997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a336c-7fbc-4ab1-8f67-796fd6b2c124 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:34.238140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-855a336c-7fbc-4ab1-8f67-796fd6b2c124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:34.354097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a336c-7fbc-4ab1-8f67-796fd6b2c124 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:34.360262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eba20-0117-4c15-9528-15c5270e0bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:34.361300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eba20-0117-4c15-9528-15c5270e0bfe service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:34.361767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eba20-0117-4c15-9528-15c5270e0bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:34.362216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eba20-0117-4c15-9528-15c5270e0bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:34.376194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3eba20-0117-4c15-9528-15c5270e0bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:34.377864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3eba20-0117-4c15-9528-15c5270e0bfe service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:34.392548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 762/1530] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:36.556365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf533cb-5428-4e21-950d-b5b0bb53abfc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:36.557146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf533cb-5428-4e21-950d-b5b0bb53abfc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:36.557146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf533cb-5428-4e21-950d-b5b0bb53abfc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:36.558462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:30:36.568899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f1ffa-6211-4b3a-b832-3ed344cbf3f1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:36.569565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f1ffa-6211-4b3a-b832-3ed344cbf3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:36.569870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f1ffa-6211-4b3a-b832-3ed344cbf3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:36.603985 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-249f1ffa-6211-4b3a-b832-3ed344cbf3f1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:36.606228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-249f1ffa-6211-4b3a-b832-3ed344cbf3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:36.618163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:30:36.951961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf533cb-5428-4e21-950d-b5b0bb53abfc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:36.969284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf533cb-5428-4e21-950d-b5b0bb53abfc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:36.973330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ecaf-ddf5-4da3-b8d5-64f95022e6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:36.974034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ecaf-ddf5-4da3-b8d5-64f95022e6ef service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:36.974307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ecaf-ddf5-4da3-b8d5-64f95022e6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:36.974574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ecaf-ddf5-4da3-b8d5-64f95022e6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:36.985986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1ecaf-ddf5-4da3-b8d5-64f95022e6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:36.987518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1ecaf-ddf5-4da3-b8d5-64f95022e6ef service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:36.998530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 770/1533] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:30:40.814078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40e010-8bd6-4557-a2d4-403869312758 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:40.814078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40e010-8bd6-4557-a2d4-403869312758 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:40.815285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40e010-8bd6-4557-a2d4-403869312758 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:40.816232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:40.822680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75695f0-d90c-4a9d-9258-e1aabbca83ee None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:40.824443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75695f0-d90c-4a9d-9258-e1aabbca83ee None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:40.824443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75695f0-d90c-4a9d-9258-e1aabbca83ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:40.846047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e75695f0-d90c-4a9d-9258-e1aabbca83ee None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:40.847341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e75695f0-d90c-4a9d-9258-e1aabbca83ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:40.856310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:30:41.426246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40e010-8bd6-4557-a2d4-403869312758 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:41.428302 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2a40e010-8bd6-4557-a2d4-403869312758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:41.523464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40e010-8bd6-4557-a2d4-403869312758 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:41.527627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a416f-d6c3-4d55-84bb-919cca1c54c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:41.528267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a416f-d6c3-4d55-84bb-919cca1c54c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:41.528567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a416f-d6c3-4d55-84bb-919cca1c54c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:41.528831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a416f-d6c3-4d55-84bb-919cca1c54c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:41.540609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a416f-d6c3-4d55-84bb-919cca1c54c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:41.543091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a416f-d6c3-4d55-84bb-919cca1c54c2 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:41.554979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 765/1536] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:43.671185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4fbaf-9862-4aea-a68a-087edd2ea843 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:43.672139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4fbaf-9862-4aea-a68a-087edd2ea843 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:43.672139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4fbaf-9862-4aea-a68a-087edd2ea843 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:43.673667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:43.681338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f302cd-3dca-4ddb-8d1d-3bf795ac4b0a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:43.681947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f302cd-3dca-4ddb-8d1d-3bf795ac4b0a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:43.682526 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f302cd-3dca-4ddb-8d1d-3bf795ac4b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:43.717308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-09f302cd-3dca-4ddb-8d1d-3bf795ac4b0a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:43.719539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-09f302cd-3dca-4ddb-8d1d-3bf795ac4b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:43.737178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:30:44.355294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4fbaf-9862-4aea-a68a-087edd2ea843 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:44.357401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-29a4fbaf-9862-4aea-a68a-087edd2ea843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:44.372970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4fbaf-9862-4aea-a68a-087edd2ea843 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:44.376969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603946c7-732f-41c6-8c55-f68269a7a01e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:44.377609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603946c7-732f-41c6-8c55-f68269a7a01e service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:44.377887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603946c7-732f-41c6-8c55-f68269a7a01e service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:44.378171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603946c7-732f-41c6-8c55-f68269a7a01e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:44.389380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603946c7-732f-41c6-8c55-f68269a7a01e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:44.390978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603946c7-732f-41c6-8c55-f68269a7a01e service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:44.402326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 773/1539] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:30:53.708929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=88 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:54.397209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=33 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:27.429510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c117f-6f24-428b-8032-48f05d9ba8a7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:27.431286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c117f-6f24-428b-8032-48f05d9ba8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:27.432034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c117f-6f24-428b-8032-48f05d9ba8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:27.480659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ff0c117f-6f24-428b-8032-48f05d9ba8a7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:27.483242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ff0c117f-6f24-428b-8032-48f05d9ba8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:27.503733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 767/1540] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:27.524864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed1162-a88f-4920-b050-628da8eb3bb5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:27.525778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed1162-a88f-4920-b050-628da8eb3bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:27.525778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed1162-a88f-4920-b050-628da8eb3bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:27.579981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e0ed1162-a88f-4920-b050-628da8eb3bb5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:27.581371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e0ed1162-a88f-4920-b050-628da8eb3bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:27.601000 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 774/1541] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:27.620752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c117f-6f24-428b-8032-48f05d9ba8a7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:27.643787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c117f-6f24-428b-8032-48f05d9ba8a7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:27.655233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad259fcc-ba81-42ae-9402-b9004d3b4a82 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:27.655908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad259fcc-ba81-42ae-9402-b9004d3b4a82 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:27.656344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e83d5-0d7c-49d8-a5a4-85e911fb892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:27.656679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad259fcc-ba81-42ae-9402-b9004d3b4a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:27.657559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e83d5-0d7c-49d8-a5a4-85e911fb892b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:27.658061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e83d5-0d7c-49d8-a5a4-85e911fb892b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:27.658556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e83d5-0d7c-49d8-a5a4-85e911fb892b admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:27.659882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e83d5-0d7c-49d8-a5a4-85e911fb892b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:27.660402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e83d5-0d7c-49d8-a5a4-85e911fb892b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:27.664907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-7d9e83d5-0d7c-49d8-a5a4-85e911fb892b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:32:27.664907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 03:32:27.664907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: Aug 24 03:32:27.664907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e83d5-0d7c-49d8-a5a4-85e911fb892b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:27.697482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 768/1542] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:32:27.700602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675b96-f158-4051-873f-5132734b8e63 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:27.701244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ad259fcc-ba81-42ae-9402-b9004d3b4a82 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:27.702902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ad259fcc-ba81-42ae-9402-b9004d3b4a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:27.703564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675b96-f158-4051-873f-5132734b8e63 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:27.704101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675b96-f158-4051-873f-5132734b8e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:27.724558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 775/1543] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:27.725505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad259fcc-ba81-42ae-9402-b9004d3b4a82 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:27.745890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-60675b96-f158-4051-873f-5132734b8e63 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:27.747637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-60675b96-f158-4051-873f-5132734b8e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:27.750247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad259fcc-ba81-42ae-9402-b9004d3b4a82 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:27.763536 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 769/1544] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:27.765265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eefbf-61f2-4524-bc0f-4a6806fe6e42 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:27.765819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eefbf-61f2-4524-bc0f-4a6806fe6e42 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:27.766389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eefbf-61f2-4524-bc0f-4a6806fe6e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:27.768684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b85dc-d507-43fa-a9a4-708b08618b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:27.774684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b85dc-d507-43fa-a9a4-708b08618b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:27.774684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b85dc-d507-43fa-a9a4-708b08618b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:27.774684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b85dc-d507-43fa-a9a4-708b08618b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:27.774684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b85dc-d507-43fa-a9a4-708b08618b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:27.774684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-138b85dc-d507-43fa-a9a4-708b08618b98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:32:27.774684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 03:32:27.774684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: Aug 24 03:32:27.775354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b85dc-d507-43fa-a9a4-708b08618b98 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:27.811222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-412eefbf-61f2-4524-bc0f-4a6806fe6e42 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:27.812906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-412eefbf-61f2-4524-bc0f-4a6806fe6e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:27.845722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 770/1545] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:27.853113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd2eda-5808-404d-9ec6-15755aebe861 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:27.853586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd2eda-5808-404d-9ec6-15755aebe861 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:27.854055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd2eda-5808-404d-9ec6-15755aebe861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:27.902612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e1cd2eda-5808-404d-9ec6-15755aebe861 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:27.904108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e1cd2eda-5808-404d-9ec6-15755aebe861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:27.920476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 776/1546] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:27 2022] POST /identity/v3/projects => generated 355 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:27.923808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 771/1547] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:27.925556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd2eda-5808-404d-9ec6-15755aebe861 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:27.925874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690c29a-4076-43be-beb9-e7555988e339 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:27.926168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690c29a-4076-43be-beb9-e7555988e339 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:27.926453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690c29a-4076-43be-beb9-e7555988e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:27.947687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd2eda-5808-404d-9ec6-15755aebe861 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:27.979025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c690c29a-4076-43be-beb9-e7555988e339 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:27.980261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c690c29a-4076-43be-beb9-e7555988e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.062936 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b27674-2fd0-411b-8c13-d67e91604c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.063944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b27674-2fd0-411b-8c13-d67e91604c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.064223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b27674-2fd0-411b-8c13-d67e91604c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.064489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b27674-2fd0-411b-8c13-d67e91604c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.065158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b27674-2fd0-411b-8c13-d67e91604c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:28.065632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b27674-2fd0-411b-8c13-d67e91604c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.067716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b27674-2fd0-411b-8c13-d67e91604c33 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.083098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 772/1548] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:32:28.084577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c92be-e81d-49b7-96b8-363f28c7577d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.084916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c92be-e81d-49b7-96b8-363f28c7577d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.085207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c92be-e81d-49b7-96b8-363f28c7577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.111447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-641c92be-e81d-49b7-96b8-363f28c7577d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:28.112913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-641c92be-e81d-49b7-96b8-363f28c7577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.124344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 773/1549] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.128240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c92be-e81d-49b7-96b8-363f28c7577d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.142499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 777/1550] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.144787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690c29a-4076-43be-beb9-e7555988e339 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.150623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c92be-e81d-49b7-96b8-363f28c7577d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.158678 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d05a7-b89e-4d6b-9a45-24f8ea5035ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.159949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d05a7-b89e-4d6b-9a45-24f8ea5035ae admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.160565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d05a7-b89e-4d6b-9a45-24f8ea5035ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.161157 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d05a7-b89e-4d6b-9a45-24f8ea5035ae admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.162466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d05a7-b89e-4d6b-9a45-24f8ea5035ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.164920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-499d05a7-b89e-4d6b-9a45-24f8ea5035ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:32:28.164920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 03:32:28.164920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: Aug 24 03:32:28.167621 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d05a7-b89e-4d6b-9a45-24f8ea5035ae admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.172841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690c29a-4076-43be-beb9-e7555988e339 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.180676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387835d-c520-4bb8-95f5-a5b56365d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.181722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387835d-c520-4bb8-95f5-a5b56365d86b admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.182160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387835d-c520-4bb8-95f5-a5b56365d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.182632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387835d-c520-4bb8-95f5-a5b56365d86b admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.183850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387835d-c520-4bb8-95f5-a5b56365d86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:28.184414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387835d-c520-4bb8-95f5-a5b56365d86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.188382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387835d-c520-4bb8-95f5-a5b56365d86b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.197372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 774/1551] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/users => generated 278 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:28.198909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c9f1-b1d3-4b63-9e7f-61070c550b27 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.199117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c9f1-b1d3-4b63-9e7f-61070c550b27 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.199392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c9f1-b1d3-4b63-9e7f-61070c550b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.214768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 778/1552] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:32:28.214768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee20af-cb5c-4872-8d81-a65674b1412c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.214768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee20af-cb5c-4872-8d81-a65674b1412c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.214768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee20af-cb5c-4872-8d81-a65674b1412c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.227953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1688c9f1-b1d3-4b63-9e7f-61070c550b27 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:28.229204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1688c9f1-b1d3-4b63-9e7f-61070c550b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.238363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 775/1553] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.241761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b0ee20af-cb5c-4872-8d81-a65674b1412c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:28.241963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c9f1-b1d3-4b63-9e7f-61070c550b27 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.242152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b0ee20af-cb5c-4872-8d81-a65674b1412c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.252394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 779/1554] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.253706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f39c80-1e7b-436a-b4e6-41e5d84d09d2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.253989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f39c80-1e7b-436a-b4e6-41e5d84d09d2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.254247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f39c80-1e7b-436a-b4e6-41e5d84d09d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.258065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c9f1-b1d3-4b63-9e7f-61070c550b27 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.263538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26986901-2d65-4fe8-a656-1d3cdc9e4ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.264492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26986901-2d65-4fe8-a656-1d3cdc9e4ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.264772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26986901-2d65-4fe8-a656-1d3cdc9e4ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.266100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26986901-2d65-4fe8-a656-1d3cdc9e4ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.266885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26986901-2d65-4fe8-a656-1d3cdc9e4ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.269337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26986901-2d65-4fe8-a656-1d3cdc9e4ffc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.278586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-98f39c80-1e7b-436a-b4e6-41e5d84d09d2 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:28.279900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-98f39c80-1e7b-436a-b4e6-41e5d84d09d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.290149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 780/1555] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.291460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bbaf4-24ef-4bba-b1b6-cf445664ee26 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.291815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bbaf4-24ef-4bba-b1b6-cf445664ee26 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.292098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bbaf4-24ef-4bba-b1b6-cf445664ee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.313371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 776/1556] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:28.315039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b23bbaf4-24ef-4bba-b1b6-cf445664ee26 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:28.315228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec25eb3-cd01-478e-b6e6-88fc20d5d515 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.315490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec25eb3-cd01-478e-b6e6-88fc20d5d515 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.315719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec25eb3-cd01-478e-b6e6-88fc20d5d515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.316480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b23bbaf4-24ef-4bba-b1b6-cf445664ee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.338532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7ec25eb3-cd01-478e-b6e6-88fc20d5d515 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:28.340258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7ec25eb3-cd01-478e-b6e6-88fc20d5d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.392734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 781/1557] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.392734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bbaf4-24ef-4bba-b1b6-cf445664ee26 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.401805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bbaf4-24ef-4bba-b1b6-cf445664ee26 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.407065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfae28-71f5-41b4-8c7a-4c1e484d1422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.407695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfae28-71f5-41b4-8c7a-4c1e484d1422 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.407960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfae28-71f5-41b4-8c7a-4c1e484d1422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.408227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfae28-71f5-41b4-8c7a-4c1e484d1422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.408891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfae28-71f5-41b4-8c7a-4c1e484d1422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.410521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfae28-71f5-41b4-8c7a-4c1e484d1422 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.421717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 782/1558] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:28.422575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfae28-71f5-41b4-8c7a-4c1e484d1422 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.430299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 777/1559] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.435019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0066f-3a6e-4e06-bb9f-abd3048e73a5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.435019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0066f-3a6e-4e06-bb9f-abd3048e73a5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.435019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0066f-3a6e-4e06-bb9f-abd3048e73a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.440301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfae28-71f5-41b4-8c7a-4c1e484d1422 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.441529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:28.448580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e996e2-fe33-4af0-b983-12ef68693195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.449444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e996e2-fe33-4af0-b983-12ef68693195 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.449681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e996e2-fe33-4af0-b983-12ef68693195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.449980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e996e2-fe33-4af0-b983-12ef68693195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.450676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e996e2-fe33-4af0-b983-12ef68693195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.454049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e996e2-fe33-4af0-b983-12ef68693195 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.456614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-59d0066f-3a6e-4e06-bb9f-abd3048e73a5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:28.457870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-59d0066f-3a6e-4e06-bb9f-abd3048e73a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.466696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 778/1560] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.468075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f5377-3628-4164-94c6-bba7626fe037 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.468360 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f5377-3628-4164-94c6-bba7626fe037 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.468628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f5377-3628-4164-94c6-bba7626fe037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.489470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:28.490695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c68f5377-3628-4164-94c6-bba7626fe037 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:28.492133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c68f5377-3628-4164-94c6-bba7626fe037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.501294 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 779/1561] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.502174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f5377-3628-4164-94c6-bba7626fe037 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.509140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 783/1562] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:28.510713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e996e2-fe33-4af0-b983-12ef68693195 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.516573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f5377-3628-4164-94c6-bba7626fe037 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.593419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa00a5-1389-4b2e-9de9-c477fb6edd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.594512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa00a5-1389-4b2e-9de9-c477fb6edd5e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.595059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa00a5-1389-4b2e-9de9-c477fb6edd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.595531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa00a5-1389-4b2e-9de9-c477fb6edd5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.596675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa00a5-1389-4b2e-9de9-c477fb6edd5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:28.597205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa00a5-1389-4b2e-9de9-c477fb6edd5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.600357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa00a5-1389-4b2e-9de9-c477fb6edd5e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.614017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e996e2-fe33-4af0-b983-12ef68693195 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.625708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 780/1563] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:32:28.626018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43b537-ce8b-4da3-be7f-3104d4b2e630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.626226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa00a5-1389-4b2e-9de9-c477fb6edd5e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.626365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43b537-ce8b-4da3-be7f-3104d4b2e630 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.626365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43b537-ce8b-4da3-be7f-3104d4b2e630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.626365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43b537-ce8b-4da3-be7f-3104d4b2e630 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.626365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43b537-ce8b-4da3-be7f-3104d4b2e630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.628043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43b537-ce8b-4da3-be7f-3104d4b2e630 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.636549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa00a5-1389-4b2e-9de9-c477fb6edd5e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.641556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4001e-fff2-4d1b-956c-1104b137abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.642190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4001e-fff2-4d1b-956c-1104b137abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.642475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4001e-fff2-4d1b-956c-1104b137abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.642772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4001e-fff2-4d1b-956c-1104b137abc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.643446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4001e-fff2-4d1b-956c-1104b137abc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:28.643749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4001e-fff2-4d1b-956c-1104b137abc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.645563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4001e-fff2-4d1b-956c-1104b137abc1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.664556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 781/1565] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:32:28.664866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 784/1565] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:28.665580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4001e-fff2-4d1b-956c-1104b137abc1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.667800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c0ab8-f572-4a50-8fc2-c2d4fabb8392 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.668399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c0ab8-f572-4a50-8fc2-c2d4fabb8392 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.668951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c0ab8-f572-4a50-8fc2-c2d4fabb8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.685442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4001e-fff2-4d1b-956c-1104b137abc1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.691397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0cf2f-59f1-4b0f-a08c-befa375f42a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.692036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0cf2f-59f1-4b0f-a08c-befa375f42a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.692312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0cf2f-59f1-4b0f-a08c-befa375f42a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.692583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0cf2f-59f1-4b0f-a08c-befa375f42a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.693247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0cf2f-59f1-4b0f-a08c-befa375f42a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.695003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0cf2f-59f1-4b0f-a08c-befa375f42a4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.697653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-117c0ab8-f572-4a50-8fc2-c2d4fabb8392 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:28.700238 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-117c0ab8-f572-4a50-8fc2-c2d4fabb8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:28.707261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 782/1566] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:28.708339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0cf2f-59f1-4b0f-a08c-befa375f42a4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.711428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 785/1567] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:28.712632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c0ab8-f572-4a50-8fc2-c2d4fabb8392 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.720410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0cf2f-59f1-4b0f-a08c-befa375f42a4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.723294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c0ab8-f572-4a50-8fc2-c2d4fabb8392 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.725652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d6c16-ab67-4ee2-86af-9ba744ff31a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.726645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d6c16-ab67-4ee2-86af-9ba744ff31a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.726954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d6c16-ab67-4ee2-86af-9ba744ff31a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.727222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d6c16-ab67-4ee2-86af-9ba744ff31a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.727894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d6c16-ab67-4ee2-86af-9ba744ff31a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:28.728194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d6c16-ab67-4ee2-86af-9ba744ff31a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.729138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e924d-abe9-4c84-ba54-278b4bfe692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.729777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e924d-abe9-4c84-ba54-278b4bfe692b admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.729897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d6c16-ab67-4ee2-86af-9ba744ff31a2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.730044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e924d-abe9-4c84-ba54-278b4bfe692b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.730335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e924d-abe9-4c84-ba54-278b4bfe692b admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.731051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e924d-abe9-4c84-ba54-278b4bfe692b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:28.731340 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e924d-abe9-4c84-ba54-278b4bfe692b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.733024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e924d-abe9-4c84-ba54-278b4bfe692b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.757053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 783/1568] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:32:28.757406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 786/1569] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:32:28.757589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d6c16-ab67-4ee2-86af-9ba744ff31a2 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.757757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e924d-abe9-4c84-ba54-278b4bfe692b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.765427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e924d-abe9-4c84-ba54-278b4bfe692b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.770245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d6c16-ab67-4ee2-86af-9ba744ff31a2 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.771957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb567c0-396b-40ef-a2dc-b8678c898c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.772794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb567c0-396b-40ef-a2dc-b8678c898c18 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.773002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb567c0-396b-40ef-a2dc-b8678c898c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.773280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb567c0-396b-40ef-a2dc-b8678c898c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.774120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb567c0-396b-40ef-a2dc-b8678c898c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.776823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb567c0-396b-40ef-a2dc-b8678c898c18 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.777113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3504a5-5e36-413c-9ff1-78d7cf13d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.777605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3504a5-5e36-413c-9ff1-78d7cf13d649 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.777882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3504a5-5e36-413c-9ff1-78d7cf13d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.778148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3504a5-5e36-413c-9ff1-78d7cf13d649 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.778953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3504a5-5e36-413c-9ff1-78d7cf13d649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.780981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3504a5-5e36-413c-9ff1-78d7cf13d649 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.809121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 784/1570] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/users => generated 293 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:28.810595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3504a5-5e36-413c-9ff1-78d7cf13d649 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.821745 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 787/1571] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:28.827666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb567c0-396b-40ef-a2dc-b8678c898c18 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.827943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3504a5-5e36-413c-9ff1-78d7cf13d649 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.911160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb567c0-396b-40ef-a2dc-b8678c898c18 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.911494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feae032-bf5a-4a95-acad-87a6439e448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.912122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feae032-bf5a-4a95-acad-87a6439e448c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.912389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feae032-bf5a-4a95-acad-87a6439e448c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.912654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feae032-bf5a-4a95-acad-87a6439e448c admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.913393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feae032-bf5a-4a95-acad-87a6439e448c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.915467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feae032-bf5a-4a95-acad-87a6439e448c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.917662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532338-62e0-4502-8b77-62e8133066fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.918512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532338-62e0-4502-8b77-62e8133066fb admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.922267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532338-62e0-4502-8b77-62e8133066fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.922825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532338-62e0-4502-8b77-62e8133066fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.924024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532338-62e0-4502-8b77-62e8133066fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.927840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532338-62e0-4502-8b77-62e8133066fb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.929833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 785/1572] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:28.930535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feae032-bf5a-4a95-acad-87a6439e448c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.941473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feae032-bf5a-4a95-acad-87a6439e448c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:28.946937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60bfd-711c-4c66-97ca-96e74791823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:28.947770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60bfd-711c-4c66-97ca-96e74791823c admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:28.948044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60bfd-711c-4c66-97ca-96e74791823c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:28.948315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60bfd-711c-4c66-97ca-96e74791823c admin admin] PATH_INFO: `/v3/projects/89d5faf83a8745ef9a6897464f1b1d6c/users/52bb5dfd3b5c474fbac63c5990ffd8ef/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:28.966602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 788/1573] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:28.966845 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c60bfd-711c-4c66-97ca-96e74791823c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d5faf83a8745ef9a6897464f1b1d6c, user_id=52bb5dfd3b5c474fbac63c5990ffd8ef, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:28.967951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532338-62e0-4502-8b77-62e8133066fb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:28.969334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c60bfd-711c-4c66-97ca-96e74791823c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:28.980191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:28.997956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 786/1574] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:28 2022] PUT /identity/v3/projects/89d5faf83a8745ef9a6897464f1b1d6c/users/52bb5dfd3b5c474fbac63c5990ffd8ef/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:28.999470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60bfd-711c-4c66-97ca-96e74791823c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.017249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:29.060079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532338-62e0-4502-8b77-62e8133066fb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.102517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60bfd-711c-4c66-97ca-96e74791823c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.107956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01f19-1f74-4073-9313-d61649932fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.108583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01f19-1f74-4073-9313-d61649932fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.108855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01f19-1f74-4073-9313-d61649932fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.109128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01f19-1f74-4073-9313-d61649932fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.109816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b01f19-1f74-4073-9313-d61649932fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.112139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b01f19-1f74-4073-9313-d61649932fd1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.151990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 787/1575] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:29.151990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01f19-1f74-4073-9313-d61649932fd1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.163568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff11ea-fe96-4f0b-b95b-6ad7a5604f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.164656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff11ea-fe96-4f0b-b95b-6ad7a5604f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.165171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff11ea-fe96-4f0b-b95b-6ad7a5604f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.165654 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff11ea-fe96-4f0b-b95b-6ad7a5604f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.166870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff11ea-fe96-4f0b-b95b-6ad7a5604f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:29.167443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff11ea-fe96-4f0b-b95b-6ad7a5604f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.170583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff11ea-fe96-4f0b-b95b-6ad7a5604f69 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.201421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 789/1576] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:32:29.201421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff11ea-fe96-4f0b-b95b-6ad7a5604f69 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.213045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff11ea-fe96-4f0b-b95b-6ad7a5604f69 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.247522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01f19-1f74-4073-9313-d61649932fd1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.255516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed24ac-91ab-48be-884f-8a5664e27696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.256757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed24ac-91ab-48be-884f-8a5664e27696 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.256757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed24ac-91ab-48be-884f-8a5664e27696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.258198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed24ac-91ab-48be-884f-8a5664e27696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.258198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed24ac-91ab-48be-884f-8a5664e27696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.260561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed24ac-91ab-48be-884f-8a5664e27696 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.310344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 788/1577] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:29 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:29.310344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed24ac-91ab-48be-884f-8a5664e27696 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.311513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f559b-2105-47e1-8444-bd25df71e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.312567 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f559b-2105-47e1-8444-bd25df71e60c admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.313382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f559b-2105-47e1-8444-bd25df71e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.313847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f559b-2105-47e1-8444-bd25df71e60c admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.314995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f559b-2105-47e1-8444-bd25df71e60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.318149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f559b-2105-47e1-8444-bd25df71e60c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.331587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 790/1578] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:29.333416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f559b-2105-47e1-8444-bd25df71e60c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.345593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f559b-2105-47e1-8444-bd25df71e60c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.402814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed24ac-91ab-48be-884f-8a5664e27696 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.407753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62f034-ed54-40e5-a8d7-bb810bb5aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.408381 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f034-ed54-40e5-a8d7-bb810bb5aca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.408653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f034-ed54-40e5-a8d7-bb810bb5aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.408919 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f034-ed54-40e5-a8d7-bb810bb5aca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.409608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62f034-ed54-40e5-a8d7-bb810bb5aca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.411578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62f034-ed54-40e5-a8d7-bb810bb5aca0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.431281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:29.435904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334b9e-54b1-4c60-9f8b-c7f46f27b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.436887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334b9e-54b1-4c60-9f8b-c7f46f27b1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.437533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 789/1579] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:29 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:29.438472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334b9e-54b1-4c60-9f8b-c7f46f27b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.438472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334b9e-54b1-4c60-9f8b-c7f46f27b1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.439721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72334b9e-54b1-4c60-9f8b-c7f46f27b1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.440212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62f034-ed54-40e5-a8d7-bb810bb5aca0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.442461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72334b9e-54b1-4c60-9f8b-c7f46f27b1d8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.452092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62f034-ed54-40e5-a8d7-bb810bb5aca0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.457367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac17697-f5f1-47a1-b5ec-a3494f1de7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.457970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 791/1580] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:29.458287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17697-f5f1-47a1-b5ec-a3494f1de7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.458580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17697-f5f1-47a1-b5ec-a3494f1de7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.458889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17697-f5f1-47a1-b5ec-a3494f1de7ec admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.459606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac17697-f5f1-47a1-b5ec-a3494f1de7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.460644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9a928-8713-413e-9a93-b0082616f703 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.461270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9a928-8713-413e-9a93-b0082616f703 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.461689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9a928-8713-413e-9a93-b0082616f703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.461888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac17697-f5f1-47a1-b5ec-a3494f1de7ec admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.471476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:29.499078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 790/1581] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:29 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:29.499078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac17697-f5f1-47a1-b5ec-a3494f1de7ec admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.508761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cfb9a928-8713-413e-9a93-b0082616f703 None None] MFA Rules not processed for user `52bb5dfd3b5c474fbac63c5990ffd8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:29.510794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cfb9a928-8713-413e-9a93-b0082616f703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:29.517477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac17697-f5f1-47a1-b5ec-a3494f1de7ec admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.525243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dfb6a-6012-4813-9326-55982212ec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.526314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dfb6a-6012-4813-9326-55982212ec8f admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.527085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dfb6a-6012-4813-9326-55982212ec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.527551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dfb6a-6012-4813-9326-55982212ec8f admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.528732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21dfb6a-6012-4813-9326-55982212ec8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.532665 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21dfb6a-6012-4813-9326-55982212ec8f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.566390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 791/1582] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:29 2022] POST /identity/v3/users => generated 294 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:29.567365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dfb6a-6012-4813-9326-55982212ec8f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.579010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dfb6a-6012-4813-9326-55982212ec8f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.592952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d010d2-0434-4036-add6-4ac526972597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.592952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d010d2-0434-4036-add6-4ac526972597 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.592952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d010d2-0434-4036-add6-4ac526972597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.592952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d010d2-0434-4036-add6-4ac526972597 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.593733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d010d2-0434-4036-add6-4ac526972597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.593733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d010d2-0434-4036-add6-4ac526972597 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.630275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 792/1583] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:29.630275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9a928-8713-413e-9a93-b0082616f703 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.639404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 792/1584] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:29 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:29.641399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d010d2-0434-4036-add6-4ac526972597 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.641849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9a928-8713-413e-9a93-b0082616f703 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.717850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d010d2-0434-4036-add6-4ac526972597 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.722804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b410576-85e3-43ab-9b1d-4dff4e8a3820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.723447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b410576-85e3-43ab-9b1d-4dff4e8a3820 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.723721 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b410576-85e3-43ab-9b1d-4dff4e8a3820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.723994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b410576-85e3-43ab-9b1d-4dff4e8a3820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.724662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b410576-85e3-43ab-9b1d-4dff4e8a3820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.726908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b410576-85e3-43ab-9b1d-4dff4e8a3820 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.731963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb09eb-b376-44f2-ac51-a81d374d9a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.732971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb09eb-b376-44f2-ac51-a81d374d9a74 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.733458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb09eb-b376-44f2-ac51-a81d374d9a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.733935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb09eb-b376-44f2-ac51-a81d374d9a74 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.735085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb09eb-b376-44f2-ac51-a81d374d9a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.742069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 793/1585] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:29.742334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb09eb-b376-44f2-ac51-a81d374d9a74 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.742482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b410576-85e3-43ab-9b1d-4dff4e8a3820 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.750230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b410576-85e3-43ab-9b1d-4dff4e8a3820 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.755007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb18db4-aa80-4d01-86b9-dfee78913af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.755613 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb18db4-aa80-4d01-86b9-dfee78913af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.755888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb18db4-aa80-4d01-86b9-dfee78913af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.756168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb18db4-aa80-4d01-86b9-dfee78913af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.757366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb18db4-aa80-4d01-86b9-dfee78913af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.759172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb18db4-aa80-4d01-86b9-dfee78913af8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.771563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 794/1586] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:29.772589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb18db4-aa80-4d01-86b9-dfee78913af8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.779061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 793/1587] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:29 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:29.779061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb09eb-b376-44f2-ac51-a81d374d9a74 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.784672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb18db4-aa80-4d01-86b9-dfee78913af8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.790404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994fe05-5dac-450c-aaba-0e7163eb8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.791037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb09eb-b376-44f2-ac51-a81d374d9a74 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.791285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994fe05-5dac-450c-aaba-0e7163eb8cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.791444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994fe05-5dac-450c-aaba-0e7163eb8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.791626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994fe05-5dac-450c-aaba-0e7163eb8cc7 admin admin] PATH_INFO: `/v3/projects/9c423ab6ae8843d0a65df1f706a3c41e/users/c8969ad404a44181b719c5546230c49a/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.797236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3883e-4056-4e54-99c4-d7ef274cb15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.797977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3883e-4056-4e54-99c4-d7ef274cb15d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.798266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3883e-4056-4e54-99c4-d7ef274cb15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.798605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3883e-4056-4e54-99c4-d7ef274cb15d admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.799471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3883e-4056-4e54-99c4-d7ef274cb15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.801608 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3883e-4056-4e54-99c4-d7ef274cb15d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.810520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994fe05-5dac-450c-aaba-0e7163eb8cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c423ab6ae8843d0a65df1f706a3c41e, user_id=c8969ad404a44181b719c5546230c49a, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.813911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994fe05-5dac-450c-aaba-0e7163eb8cc7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.820263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 794/1588] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:29.820263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3883e-4056-4e54-99c4-d7ef274cb15d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.833915 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3883e-4056-4e54-99c4-d7ef274cb15d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.834565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 795/1589] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:29 2022] PUT /identity/v3/projects/9c423ab6ae8843d0a65df1f706a3c41e/users/c8969ad404a44181b719c5546230c49a/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:29.839935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994fe05-5dac-450c-aaba-0e7163eb8cc7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.921802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ee7b3-3ff5-49d2-9f0e-49c70e444271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.922594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ee7b3-3ff5-49d2-9f0e-49c70e444271 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.923032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ee7b3-3ff5-49d2-9f0e-49c70e444271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.923514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ee7b3-3ff5-49d2-9f0e-49c70e444271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.924283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ee7b3-3ff5-49d2-9f0e-49c70e444271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.926181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ee7b3-3ff5-49d2-9f0e-49c70e444271 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.929892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994fe05-5dac-450c-aaba-0e7163eb8cc7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.935720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52109e-d790-4153-bd68-a572f8df1c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.936624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52109e-d790-4153-bd68-a572f8df1c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.936962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52109e-d790-4153-bd68-a572f8df1c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.937358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52109e-d790-4153-bd68-a572f8df1c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.938557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52109e-d790-4153-bd68-a572f8df1c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.938763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 795/1590] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:29.941168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52109e-d790-4153-bd68-a572f8df1c21 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.942872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ee7b3-3ff5-49d2-9f0e-49c70e444271 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.953712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ee7b3-3ff5-49d2-9f0e-49c70e444271 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:29.953977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:29.959145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87bf2-bcdb-456f-b07f-0ddfaecca1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:29.959833 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87bf2-bcdb-456f-b07f-0ddfaecca1ac admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:29.960110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87bf2-bcdb-456f-b07f-0ddfaecca1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:29.960381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87bf2-bcdb-456f-b07f-0ddfaecca1ac admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:29.961028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab87bf2-bcdb-456f-b07f-0ddfaecca1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:29.963016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab87bf2-bcdb-456f-b07f-0ddfaecca1ac admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:29.973080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:29.984010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 796/1591] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:29 2022] POST /identity/v3/projects => generated 357 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:29.985719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52109e-d790-4153-bd68-a572f8df1c21 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:29.993342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 796/1592] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:29 2022] POST /identity/v3/users => generated 292 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:29.994210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87bf2-bcdb-456f-b07f-0ddfaecca1ac admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.010137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87bf2-bcdb-456f-b07f-0ddfaecca1ac admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.081350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52109e-d790-4153-bd68-a572f8df1c21 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.088244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2415a-6675-44da-904d-8858e1aaa7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.089034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2415a-6675-44da-904d-8858e1aaa7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.089468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2415a-6675-44da-904d-8858e1aaa7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.089625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2415a-6675-44da-904d-8858e1aaa7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.090394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2415a-6675-44da-904d-8858e1aaa7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.091237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8a05-7ff8-4d7e-9f12-2661f1c1cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.092163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2415a-6675-44da-904d-8858e1aaa7d1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.092335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8a05-7ff8-4d7e-9f12-2661f1c1cade admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.092682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8a05-7ff8-4d7e-9f12-2661f1c1cade admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.093104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8a05-7ff8-4d7e-9f12-2661f1c1cade admin admin] PATH_INFO: `/v3/projects/2756fd68c251459dac37e4ef4f6ae8e0/users/bc15e6a23f82446c8026be62782c1071/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.109155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 797/1593] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:30.109155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2415a-6675-44da-904d-8858e1aaa7d1 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.114068 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b8a05-7ff8-4d7e-9f12-2661f1c1cade admin admin] RBAC: Authorizing `identity:create_grant(project_id=2756fd68c251459dac37e4ef4f6ae8e0, user_id=bc15e6a23f82446c8026be62782c1071, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.119469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b8a05-7ff8-4d7e-9f12-2661f1c1cade admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.122792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2415a-6675-44da-904d-8858e1aaa7d1 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.129319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bce319-0ba4-4a20-9b47-21ec81aa3c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.130262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bce319-0ba4-4a20-9b47-21ec81aa3c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.130718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bce319-0ba4-4a20-9b47-21ec81aa3c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.131128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bce319-0ba4-4a20-9b47-21ec81aa3c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.132264 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bce319-0ba4-4a20-9b47-21ec81aa3c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.135203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bce319-0ba4-4a20-9b47-21ec81aa3c36 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.142356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 797/1594] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:29 2022] PUT /identity/v3/projects/2756fd68c251459dac37e4ef4f6ae8e0/users/bc15e6a23f82446c8026be62782c1071/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:30.142356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8a05-7ff8-4d7e-9f12-2661f1c1cade admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.156658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 798/1595] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:30.158141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98371faf-c23b-41fb-bb62-17c5018c7db6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.158508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98371faf-c23b-41fb-bb62-17c5018c7db6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.159047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98371faf-c23b-41fb-bb62-17c5018c7db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.193253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-98371faf-c23b-41fb-bb62-17c5018c7db6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:30.195475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-98371faf-c23b-41fb-bb62-17c5018c7db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:30.240687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8a05-7ff8-4d7e-9f12-2661f1c1cade admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.245938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d1d5e-a38f-44d5-97e7-845b4a151986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.246561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d1d5e-a38f-44d5-97e7-845b4a151986 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.246864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d1d5e-a38f-44d5-97e7-845b4a151986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.247131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d1d5e-a38f-44d5-97e7-845b4a151986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.247808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d1d5e-a38f-44d5-97e7-845b4a151986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.249966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d1d5e-a38f-44d5-97e7-845b4a151986 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.266094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 798/1596] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:30.267039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d1d5e-a38f-44d5-97e7-845b4a151986 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.281882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d1d5e-a38f-44d5-97e7-845b4a151986 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.290422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e3b68-ed95-4c61-9dc4-fa81c115d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.291517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3b68-ed95-4c61-9dc4-fa81c115d58e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.291994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3b68-ed95-4c61-9dc4-fa81c115d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.292481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3b68-ed95-4c61-9dc4-fa81c115d58e admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.297841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 799/1597] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:30.298077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e3b68-ed95-4c61-9dc4-fa81c115d58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.298167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98371faf-c23b-41fb-bb62-17c5018c7db6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.298245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e3b68-ed95-4c61-9dc4-fa81c115d58e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.313811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98371faf-c23b-41fb-bb62-17c5018c7db6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.314894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 799/1598] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:30.316439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e3b68-ed95-4c61-9dc4-fa81c115d58e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.323184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e359afd-10ad-42ba-94c7-8adf9229398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.324330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359afd-10ad-42ba-94c7-8adf9229398f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.326606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359afd-10ad-42ba-94c7-8adf9229398f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.327138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359afd-10ad-42ba-94c7-8adf9229398f admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.328347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e359afd-10ad-42ba-94c7-8adf9229398f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.332172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e359afd-10ad-42ba-94c7-8adf9229398f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.339185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e3b68-ed95-4c61-9dc4-fa81c115d58e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.353683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6fd1c-8219-4e29-aea9-9684e3ae85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.356768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6fd1c-8219-4e29-aea9-9684e3ae85f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.357226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6fd1c-8219-4e29-aea9-9684e3ae85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.357704 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6fd1c-8219-4e29-aea9-9684e3ae85f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.359042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6fd1c-8219-4e29-aea9-9684e3ae85f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.362185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6fd1c-8219-4e29-aea9-9684e3ae85f9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.363841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 800/1599] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:30 2022] POST /identity/v3/users => generated 285 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:30.365312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e359afd-10ad-42ba-94c7-8adf9229398f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.377855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e359afd-10ad-42ba-94c7-8adf9229398f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.384758 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d880d-a28c-4ece-bdac-82d945c6c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.385467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 800/1600] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:30.385589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d880d-a28c-4ece-bdac-82d945c6c6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.385688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d880d-a28c-4ece-bdac-82d945c6c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.385890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d880d-a28c-4ece-bdac-82d945c6c6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.386552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d880d-a28c-4ece-bdac-82d945c6c6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.386855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6fd1c-8219-4e29-aea9-9684e3ae85f9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.388224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d880d-a28c-4ece-bdac-82d945c6c6ce admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.403011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6fd1c-8219-4e29-aea9-9684e3ae85f9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.403683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 801/1601] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:30.405805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3b7a-2bd5-4c22-a8d9-6ce5093b6c44 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.406246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3b7a-2bd5-4c22-a8d9-6ce5093b6c44 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.406747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3b7a-2bd5-4c22-a8d9-6ce5093b6c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.414552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af416d46-d5bc-456c-9c5a-37c99375e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.415702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af416d46-d5bc-456c-9c5a-37c99375e544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.416236 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af416d46-d5bc-456c-9c5a-37c99375e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.416740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af416d46-d5bc-456c-9c5a-37c99375e544 admin admin] PATH_INFO: `/v3/projects/d32cfa50483640e7b56a1cf1dea66962/users/9a959849555c454d824342fa4eb7470d/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.441893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af416d46-d5bc-456c-9c5a-37c99375e544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32cfa50483640e7b56a1cf1dea66962, user_id=9a959849555c454d824342fa4eb7470d, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.445912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af416d46-d5bc-456c-9c5a-37c99375e544 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.450255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b04f3b7a-2bd5-4c22-a8d9-6ce5093b6c44 None None] MFA Rules not processed for user `bc15e6a23f82446c8026be62782c1071`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:30.452418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b04f3b7a-2bd5-4c22-a8d9-6ce5093b6c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:30.464956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 801/1602] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:30 2022] PUT /identity/v3/projects/d32cfa50483640e7b56a1cf1dea66962/users/9a959849555c454d824342fa4eb7470d/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:30.466369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af416d46-d5bc-456c-9c5a-37c99375e544 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.509141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:30.543280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:30.571598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af416d46-d5bc-456c-9c5a-37c99375e544 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.576843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbe651-65cc-47d9-a3be-afbc09522124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.577531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe651-65cc-47d9-a3be-afbc09522124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.577802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe651-65cc-47d9-a3be-afbc09522124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.578069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe651-65cc-47d9-a3be-afbc09522124 admin admin] PATH_INFO: `/v3/projects/8a745b184d3a462fae7c81ce668b01d2/users/1507cffe84dc4849a7040333ad48d99c/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.587534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 802/1603] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:30.590752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f3b7a-2bd5-4c22-a8d9-6ce5093b6c44 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.601709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbe651-65cc-47d9-a3be-afbc09522124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a745b184d3a462fae7c81ce668b01d2, user_id=1507cffe84dc4849a7040333ad48d99c, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.607474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbe651-65cc-47d9-a3be-afbc09522124 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.645166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 802/1604] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:30 2022] PUT /identity/v3/projects/8a745b184d3a462fae7c81ce668b01d2/users/1507cffe84dc4849a7040333ad48d99c/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:30.649875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbe651-65cc-47d9-a3be-afbc09522124 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.671097 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f3b7a-2bd5-4c22-a8d9-6ce5093b6c44 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.739836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2615a01-c855-4e11-9b7e-bc5addffef77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.743888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2615a01-c855-4e11-9b7e-bc5addffef77 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.744513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2615a01-c855-4e11-9b7e-bc5addffef77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.745005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2615a01-c855-4e11-9b7e-bc5addffef77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.775255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbe651-65cc-47d9-a3be-afbc09522124 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.786028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5409a-1452-4047-a2c7-4cea68bd65d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.787415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5409a-1452-4047-a2c7-4cea68bd65d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.787965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5409a-1452-4047-a2c7-4cea68bd65d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.788425 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5409a-1452-4047-a2c7-4cea68bd65d5 admin admin] PATH_INFO: `/v3/projects/70bebe773822488a90a1258551c3f09b/users/45285b561f424fde9297724c6768250d/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.820877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5409a-1452-4047-a2c7-4cea68bd65d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bebe773822488a90a1258551c3f09b, user_id=45285b561f424fde9297724c6768250d, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.824393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5409a-1452-4047-a2c7-4cea68bd65d5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.834862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2615a01-c855-4e11-9b7e-bc5addffef77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.836806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2615a01-c855-4e11-9b7e-bc5addffef77 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:30.849538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 803/1605] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:30 2022] PUT /identity/v3/projects/70bebe773822488a90a1258551c3f09b/users/45285b561f424fde9297724c6768250d/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:30.851917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5409a-1452-4047-a2c7-4cea68bd65d5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.852429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 803/1606] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:30.855113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2615a01-c855-4e11-9b7e-bc5addffef77 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:30.872844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2615a01-c855-4e11-9b7e-bc5addffef77 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.964070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:30.978599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5409a-1452-4047-a2c7-4cea68bd65d5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:30.987497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262152b-f756-407f-b650-28bb3421ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:30.988526 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262152b-f756-407f-b650-28bb3421ed84 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:30.989005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262152b-f756-407f-b650-28bb3421ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:30.989564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262152b-f756-407f-b650-28bb3421ed84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:30.990820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262152b-f756-407f-b650-28bb3421ed84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:30.994106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262152b-f756-407f-b650-28bb3421ed84 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:31.010096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bce52-bed8-41b8-89c7-cc09f8501644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:31.011421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bce52-bed8-41b8-89c7-cc09f8501644 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.011949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bce52-bed8-41b8-89c7-cc09f8501644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.012534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bce52-bed8-41b8-89c7-cc09f8501644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.022118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bce52-bed8-41b8-89c7-cc09f8501644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:31.023135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 804/1607] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:31.023135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262152b-f756-407f-b650-28bb3421ed84 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:31.023630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bce52-bed8-41b8-89c7-cc09f8501644 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:31.039894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262152b-f756-407f-b650-28bb3421ed84 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:31.043798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 804/1608] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:31.043798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d973cf-44e4-4544-b0c0-751a32cff692 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.043798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d973cf-44e4-4544-b0c0-751a32cff692 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.044270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d973cf-44e4-4544-b0c0-751a32cff692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.049165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209be6e-2ed9-4c1b-899a-7c918411aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:31.050148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209be6e-2ed9-4c1b-899a-7c918411aa65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.050642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209be6e-2ed9-4c1b-899a-7c918411aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.051107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209be6e-2ed9-4c1b-899a-7c918411aa65 admin admin] PATH_INFO: `/v3/projects/a524a2006c9345f5a265d71322c1fc33/users/aaeb70714612431bbcd63f1105ff9ae5/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.079431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209be6e-2ed9-4c1b-899a-7c918411aa65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a524a2006c9345f5a265d71322c1fc33, user_id=aaeb70714612431bbcd63f1105ff9ae5, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:31.082768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209be6e-2ed9-4c1b-899a-7c918411aa65 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:31.099663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-02d973cf-44e4-4544-b0c0-751a32cff692 None None] MFA Rules not processed for user `9a959849555c454d824342fa4eb7470d`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:31.101653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-02d973cf-44e4-4544-b0c0-751a32cff692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:31.111129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:31.114877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 805/1609] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:31 2022] PUT /identity/v3/projects/a524a2006c9345f5a265d71322c1fc33/users/aaeb70714612431bbcd63f1105ff9ae5/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:31.119419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d753eab-bb5b-4c8e-9ce2-cacce1991016 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.120374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d753eab-bb5b-4c8e-9ce2-cacce1991016 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.121005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d753eab-bb5b-4c8e-9ce2-cacce1991016 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.123365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 806/1610] 10.222.0.78 () {54 vars in 962 bytes} [Wed Aug 24 03:32:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:32:31.125288 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139f8a1-88d2-4b15-8713-29e632353684 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.125938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139f8a1-88d2-4b15-8713-29e632353684 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.126468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139f8a1-88d2-4b15-8713-29e632353684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.159787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c139f8a1-88d2-4b15-8713-29e632353684 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:31.161692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c139f8a1-88d2-4b15-8713-29e632353684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:31.218186 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 805/1611] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:31.219461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788d3f4-83d3-4501-b798-de6a10df1ee4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.219805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788d3f4-83d3-4501-b798-de6a10df1ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.220272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788d3f4-83d3-4501-b798-de6a10df1ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.246290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f788d3f4-83d3-4501-b798-de6a10df1ee4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:31.247580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f788d3f4-83d3-4501-b798-de6a10df1ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:31.295769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 807/1612] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:31.298246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139f8a1-88d2-4b15-8713-29e632353684 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:31.313907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139f8a1-88d2-4b15-8713-29e632353684 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:31.320961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3756ec0-7dc8-4a88-9a1d-10e6a8e7a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:31.320961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756ec0-7dc8-4a88-9a1d-10e6a8e7a9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.321560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756ec0-7dc8-4a88-9a1d-10e6a8e7a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.321803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756ec0-7dc8-4a88-9a1d-10e6a8e7a9c6 admin admin] PATH_INFO: `/v3/projects/74eafc75882a43758d444e584b14c90c/users/252873ea08e04dc8bad55fa0bcc1edd7/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.359953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3756ec0-7dc8-4a88-9a1d-10e6a8e7a9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74eafc75882a43758d444e584b14c90c, user_id=252873ea08e04dc8bad55fa0bcc1edd7, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:31.364671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 806/1613] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:31.364671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788d3f4-83d3-4501-b798-de6a10df1ee4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:31.364946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3756ec0-7dc8-4a88-9a1d-10e6a8e7a9c6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:31.373701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788d3f4-83d3-4501-b798-de6a10df1ee4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:31.379734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667ce43-ddf2-4a6f-a091-4d25dbc2f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:31.380449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667ce43-ddf2-4a6f-a091-4d25dbc2f2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.380787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667ce43-ddf2-4a6f-a091-4d25dbc2f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.381063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667ce43-ddf2-4a6f-a091-4d25dbc2f2b6 admin admin] PATH_INFO: `/v3/projects/3989b5dc1ded4718af973b4e794ff1be/users/f447a34300944a5da25f6408f802f602/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.393633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 808/1614] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:31 2022] PUT /identity/v3/projects/74eafc75882a43758d444e584b14c90c/users/252873ea08e04dc8bad55fa0bcc1edd7/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:31.396058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651bd5-1654-4f7a-8a0a-b8dc49fcf435 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.396619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651bd5-1654-4f7a-8a0a-b8dc49fcf435 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.397063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651bd5-1654-4f7a-8a0a-b8dc49fcf435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.405192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667ce43-ddf2-4a6f-a091-4d25dbc2f2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3989b5dc1ded4718af973b4e794ff1be, user_id=f447a34300944a5da25f6408f802f602, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:31.406429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-a667ce43-ddf2-4a6f-a091-4d25dbc2f2b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:32:31.406429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 03:32:31.406429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: Aug 24 03:32:31.408488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667ce43-ddf2-4a6f-a091-4d25dbc2f2b6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:31.426782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 807/1615] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:31 2022] PUT /identity/v3/projects/3989b5dc1ded4718af973b4e794ff1be/users/f447a34300944a5da25f6408f802f602/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:31.428844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15349275-d1de-4b15-a944-2d4923b841dd None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.429208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15349275-d1de-4b15-a944-2d4923b841dd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.429549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15349275-d1de-4b15-a944-2d4923b841dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.446948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f8651bd5-1654-4f7a-8a0a-b8dc49fcf435 None None] MFA Rules not processed for user `aaeb70714612431bbcd63f1105ff9ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:31.452507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f8651bd5-1654-4f7a-8a0a-b8dc49fcf435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:31.486476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-15349275-d1de-4b15-a944-2d4923b841dd None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:31.487741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-15349275-d1de-4b15-a944-2d4923b841dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:31.567042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:31.582697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 809/1616] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:31.582697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f618391-212d-492b-829d-5f8a0c98d0e1 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.582697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f618391-212d-492b-829d-5f8a0c98d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.582697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f618391-212d-492b-829d-5f8a0c98d0e1 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.584765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 810/1617] 10.222.0.78 () {54 vars in 962 bytes} [Wed Aug 24 03:32:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:32:31.585634 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f618391-212d-492b-829d-5f8a0c98d0e1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:31.643879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 808/1618] 10.222.0.78 () {58 vars in 1059 bytes} [Wed Aug 24 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:31.645364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15349275-d1de-4b15-a944-2d4923b841dd None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:31.647474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-15349275-d1de-4b15-a944-2d4923b841dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:31.736258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f618391-212d-492b-829d-5f8a0c98d0e1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:31.751005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8400882-76fd-46f8-8231-4af34221b370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:31.752292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8400882-76fd-46f8-8231-4af34221b370 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.755999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8400882-76fd-46f8-8231-4af34221b370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.757329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8400882-76fd-46f8-8231-4af34221b370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.759300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15349275-d1de-4b15-a944-2d4923b841dd None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:31.764278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ec753-ef60-4232-b198-e018219d2086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:31.764933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ec753-ef60-4232-b198-e018219d2086 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.765211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ec753-ef60-4232-b198-e018219d2086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.765489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ec753-ef60-4232-b198-e018219d2086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.811247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:31.869038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8400882-76fd-46f8-8231-4af34221b370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:31.870449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8400882-76fd-46f8-8231-4af34221b370 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:31.882094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 811/1619] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:31.888067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8400882-76fd-46f8-8231-4af34221b370 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:31.889281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ec753-ef60-4232-b198-e018219d2086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:31.892086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ec753-ef60-4232-b198-e018219d2086 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:31.901626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8400882-76fd-46f8-8231-4af34221b370 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:31.908869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 809/1620] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:31.909324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef357796-880c-4818-9e38-4519e449f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:31.910113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef357796-880c-4818-9e38-4519e449f050 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.910430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef357796-880c-4818-9e38-4519e449f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.910772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef357796-880c-4818-9e38-4519e449f050 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.911493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef357796-880c-4818-9e38-4519e449f050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:31.912625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d7d53-ef2e-44cc-9f8c-a59b71dae8aa None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.913385 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d7d53-ef2e-44cc-9f8c-a59b71dae8aa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.914070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d7d53-ef2e-44cc-9f8c-a59b71dae8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.914357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef357796-880c-4818-9e38-4519e449f050 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:31.932957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 812/1621] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:31.934572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeca78-b554-482d-997e-d0c245f27773 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:31.934900 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeca78-b554-482d-997e-d0c245f27773 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:31.935330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeca78-b554-482d-997e-d0c245f27773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:31.957212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-900d7d53-ef2e-44cc-9f8c-a59b71dae8aa None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:31.960005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-900d7d53-ef2e-44cc-9f8c-a59b71dae8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:31.969980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-dfeeca78-b554-482d-997e-d0c245f27773 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:31.971373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dfeeca78-b554-482d-997e-d0c245f27773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:31.979903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 810/1622] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:31.982074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d7d53-ef2e-44cc-9f8c-a59b71dae8aa None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:31.998676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 813/1623] 10.222.0.78 () {58 vars in 1059 bytes} [Wed Aug 24 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:31.999910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeca78-b554-482d-997e-d0c245f27773 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:32.014591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeca78-b554-482d-997e-d0c245f27773 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:32.031485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b036-e358-4881-b50e-0fc535a7e4f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:32.032608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b036-e358-4881-b50e-0fc535a7e4f7 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:32.032885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b036-e358-4881-b50e-0fc535a7e4f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:32.033154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b036-e358-4881-b50e-0fc535a7e4f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:32.131350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3b036-e358-4881-b50e-0fc535a7e4f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:32.133289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3b036-e358-4881-b50e-0fc535a7e4f7 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:32.135694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d7d53-ef2e-44cc-9f8c-a59b71dae8aa None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:32.143111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd499a-6ae6-45fa-bfb5-def1af6207e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:32.144227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 814/1624] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:32.144849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd499a-6ae6-45fa-bfb5-def1af6207e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:32.145203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b036-e358-4881-b50e-0fc535a7e4f7 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:32.145620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd499a-6ae6-45fa-bfb5-def1af6207e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:32.146177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd499a-6ae6-45fa-bfb5-def1af6207e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:32.157895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b036-e358-4881-b50e-0fc535a7e4f7 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:32.164979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b24ec-bcc6-4550-b23a-cf72c2293115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:32.166050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b24ec-bcc6-4550-b23a-cf72c2293115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:32.166279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b24ec-bcc6-4550-b23a-cf72c2293115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:32.166719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b24ec-bcc6-4550-b23a-cf72c2293115 admin admin] PATH_INFO: `/v3/projects/74eafc75882a43758d444e584b14c90c/users/252873ea08e04dc8bad55fa0bcc1edd7/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:32.169254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd499a-6ae6-45fa-bfb5-def1af6207e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:32.169490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b24ec-bcc6-4550-b23a-cf72c2293115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74eafc75882a43758d444e584b14c90c, user_id=252873ea08e04dc8bad55fa0bcc1edd7, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:32.172900 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b24ec-bcc6-4550-b23a-cf72c2293115 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:32.176331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd499a-6ae6-45fa-bfb5-def1af6207e6 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:32.202695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 815/1625] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:32 2022] PUT /identity/v3/projects/74eafc75882a43758d444e584b14c90c/users/252873ea08e04dc8bad55fa0bcc1edd7/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:32.202695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b24ec-bcc6-4550-b23a-cf72c2293115 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:32.208613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 811/1626] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:32.209791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd499a-6ae6-45fa-bfb5-def1af6207e6 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:32.251389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd499a-6ae6-45fa-bfb5-def1af6207e6 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:32.292170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:32.299737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b24ec-bcc6-4550-b23a-cf72c2293115 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:32.307769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f72b40-58cc-4689-9f31-bace8472d114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:32.308549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f72b40-58cc-4689-9f31-bace8472d114 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:32.308888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f72b40-58cc-4689-9f31-bace8472d114 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:32.309219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f72b40-58cc-4689-9f31-bace8472d114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:32.333272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:32.388789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f72b40-58cc-4689-9f31-bace8472d114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:32.391125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f72b40-58cc-4689-9f31-bace8472d114 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:32.404911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 816/1627] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:32.407266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5a624-4205-424f-91c1-f1a918549f0a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:32.407579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5a624-4205-424f-91c1-f1a918549f0a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:32.407980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5a624-4205-424f-91c1-f1a918549f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:32.449198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e2d5a624-4205-424f-91c1-f1a918549f0a None None] MFA Rules not processed for user `252873ea08e04dc8bad55fa0bcc1edd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:32.451080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e2d5a624-4205-424f-91c1-f1a918549f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:32.490843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cf2b5-a1c0-4cff-be84-fa4f273a5570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:32.493171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cf2b5-a1c0-4cff-be84-fa4f273a5570 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:32.493171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cf2b5-a1c0-4cff-be84-fa4f273a5570 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:32.493400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cf2b5-a1c0-4cff-be84-fa4f273a5570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:32.606303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 817/1628] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:32.623110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5a624-4205-424f-91c1-f1a918549f0a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:32.717296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cf2b5-a1c0-4cff-be84-fa4f273a5570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:32.735610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cf2b5-a1c0-4cff-be84-fa4f273a5570 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:32.777669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 812/1629] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:32.779810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5a624-4205-424f-91c1-f1a918549f0a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:32.788625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9ebe2-05ea-4687-83c4-6db30fc2e710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:32.790234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ebe2-05ea-4687-83c4-6db30fc2e710 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:32.790234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ebe2-05ea-4687-83c4-6db30fc2e710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:32.793806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ebe2-05ea-4687-83c4-6db30fc2e710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:32.818327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9ebe2-05ea-4687-83c4-6db30fc2e710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:32.819936 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9ebe2-05ea-4687-83c4-6db30fc2e710 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:32.856089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 818/1630] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:32:33.073833 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cf2b5-a1c0-4cff-be84-fa4f273a5570 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:33.115541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cf2b5-a1c0-4cff-be84-fa4f273a5570 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:33.136632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7d592-bc14-4b35-bd4f-85246f67ad8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:33.140632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7d592-bc14-4b35-bd4f-85246f67ad8d service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:33.141191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7d592-bc14-4b35-bd4f-85246f67ad8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:33.141737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7d592-bc14-4b35-bd4f-85246f67ad8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:33.169907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50a62d-ccc5-4568-9996-ffa607710b83 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:33.170578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50a62d-ccc5-4568-9996-ffa607710b83 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:33.171218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50a62d-ccc5-4568-9996-ffa607710b83 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:33.173000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 819/1631] 10.222.0.78 () {54 vars in 912 bytes} [Wed Aug 24 03:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:32:33.176766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09495778-cd09-4edf-b16d-176d73c6f852 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:33.177377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09495778-cd09-4edf-b16d-176d73c6f852 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:33.177952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09495778-cd09-4edf-b16d-176d73c6f852 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:33.180294 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 820/1632] 10.222.0.78 () {54 vars in 912 bytes} [Wed Aug 24 03:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:32:33.182114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07d2b-7680-4fa6-856b-7dbf765268c4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:33.182712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07d2b-7680-4fa6-856b-7dbf765268c4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:33.183282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07d2b-7680-4fa6-856b-7dbf765268c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:33.224230 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e9b07d2b-7680-4fa6-856b-7dbf765268c4 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:33.226139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e9b07d2b-7680-4fa6-856b-7dbf765268c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:33.247750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 821/1633] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:32:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:33.250176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90231a-6088-4c1f-be08-1922c083da25 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:33.250576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90231a-6088-4c1f-be08-1922c083da25 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:33.250934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90231a-6088-4c1f-be08-1922c083da25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:33.280904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-df90231a-6088-4c1f-be08-1922c083da25 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:33.281810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-df90231a-6088-4c1f-be08-1922c083da25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:33.297522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 822/1634] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:32:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:33.399076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7d592-bc14-4b35-bd4f-85246f67ad8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:33.403298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7d592-bc14-4b35-bd4f-85246f67ad8d service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:33.433581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90231a-6088-4c1f-be08-1922c083da25 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:33.438865 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 813/1635] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:33.465203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90231a-6088-4c1f-be08-1922c083da25 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:33.481293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dfa4b-98ea-49eb-9cb1-93631cde2fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:33.484300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dfa4b-98ea-49eb-9cb1-93631cde2fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:33.492347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dfa4b-98ea-49eb-9cb1-93631cde2fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:33.498327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dfa4b-98ea-49eb-9cb1-93631cde2fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:33.535727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534dfa4b-98ea-49eb-9cb1-93631cde2fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:33.553931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534dfa4b-98ea-49eb-9cb1-93631cde2fc7 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:33.600100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 823/1636] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:34.147032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7d592-bc14-4b35-bd4f-85246f67ad8d service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:34.216712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7d592-bc14-4b35-bd4f-85246f67ad8d service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:34.237515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532a9ff-5c12-47c2-b374-0fcae7bec5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:34.241031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532a9ff-5c12-47c2-b374-0fcae7bec5fe service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:34.251275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532a9ff-5c12-47c2-b374-0fcae7bec5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:34.252521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532a9ff-5c12-47c2-b374-0fcae7bec5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:34.287984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532a9ff-5c12-47c2-b374-0fcae7bec5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:34.289804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532a9ff-5c12-47c2-b374-0fcae7bec5fe service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:34.322765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 814/1637] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:38.442258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dfa4b-98ea-49eb-9cb1-93631cde2fc7 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:38.487187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dfa4b-98ea-49eb-9cb1-93631cde2fc7 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:38.495354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:38.498884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:38.502037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:38.502694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] PATH_INFO: `/v3/users/9a959849555c454d824342fa4eb7470d` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:38.504331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a959849555c454d824342fa4eb7470d)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:38.509253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:38.544592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:38.652368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a959849555c454d824342fa4eb7470d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:38.658792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a959849555c454d824342fa4eb7470d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:38.747418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a959849555c454d824342fa4eb7470d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:38.779285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a959849555c454d824342fa4eb7470d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:38.801901 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a959849555c454d824342fa4eb7470d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:38.834688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 824/1638] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:32:38 2022] DELETE /identity/v3/users/9a959849555c454d824342fa4eb7470d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:38.841375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d27df4-7300-411c-b6f3-4dbf1b8eda15 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:38.841873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d27df4-7300-411c-b6f3-4dbf1b8eda15 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:38.842189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d27df4-7300-411c-b6f3-4dbf1b8eda15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:38.951770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-85d27df4-7300-411c-b6f3-4dbf1b8eda15 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:38.953221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-85d27df4-7300-411c-b6f3-4dbf1b8eda15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:39.106727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:39.187605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 815/1639] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:39.401197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:39.402756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:39.564696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c7c65-da73-4556-930a-501ad8e562b8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:39.581728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00bff2-8f2e-4bea-adb4-34754f58ea1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:39.584519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00bff2-8f2e-4bea-adb4-34754f58ea1f service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:39.584998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00bff2-8f2e-4bea-adb4-34754f58ea1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:39.585410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00bff2-8f2e-4bea-adb4-34754f58ea1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:39.622606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00bff2-8f2e-4bea-adb4-34754f58ea1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:39.625365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00bff2-8f2e-4bea-adb4-34754f58ea1f service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:39.671467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 825/1640] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:41.906738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d27df4-7300-411c-b6f3-4dbf1b8eda15 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:41.911118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-85d27df4-7300-411c-b6f3-4dbf1b8eda15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:41.943924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d27df4-7300-411c-b6f3-4dbf1b8eda15 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:41.962737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:41.963899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:41.964329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:41.964757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] PATH_INFO: `/v3/users/bc15e6a23f82446c8026be62782c1071` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:41.966736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc15e6a23f82446c8026be62782c1071)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:41.969882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:32:41.969882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 03:32:41.969882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: Aug 24 03:32:41.972192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:42.208619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc15e6a23f82446c8026be62782c1071'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:42.210887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc15e6a23f82446c8026be62782c1071'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:42.212610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc15e6a23f82446c8026be62782c1071'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:42.307379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc15e6a23f82446c8026be62782c1071'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:42.365337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc15e6a23f82446c8026be62782c1071'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:42.439018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 816/1641] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:32:41 2022] DELETE /identity/v3/users/bc15e6a23f82446c8026be62782c1071 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:32:42.441808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dde1e-e6ea-4334-9a1e-6fe89f35b471 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:42.442614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dde1e-e6ea-4334-9a1e-6fe89f35b471 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:42.443074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dde1e-e6ea-4334-9a1e-6fe89f35b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:42.448460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:42.455152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:42.588686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8b2dde1e-e6ea-4334-9a1e-6fe89f35b471 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:42.599346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8b2dde1e-e6ea-4334-9a1e-6fe89f35b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:42.822448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006f035-78ea-4733-8a58-0aede1a8c75e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:42.860864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 826/1642] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:42.866565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:42.879481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:42.879870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:42.880270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] PATH_INFO: `/v3/projects/d32cfa50483640e7b56a1cf1dea66962` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:42.889376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32cfa50483640e7b56a1cf1dea66962)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:42.897867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:42.930705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dde1e-e6ea-4334-9a1e-6fe89f35b471 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:42.932069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8b2dde1e-e6ea-4334-9a1e-6fe89f35b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:43.086488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32cfa50483640e7b56a1cf1dea66962', 'request_id': 'req-91cb1a86-1900-4122-8b8c-54f8665272b4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:43.099184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32cfa50483640e7b56a1cf1dea66962', 'request_id': 'req-91cb1a86-1900-4122-8b8c-54f8665272b4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:43.120310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:43.128791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32cfa50483640e7b56a1cf1dea66962', 'request_id': 'req-91cb1a86-1900-4122-8b8c-54f8665272b4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:43.137969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:43.169436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] The token cache is being invalidate because project d32cfa50483640e7b56a1cf1dea66962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:32:43.172232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:43.174183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-91cb1a86-1900-4122-8b8c-54f8665272b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:43.184427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 817/1643] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:32:42 2022] DELETE /identity/v3/projects/d32cfa50483640e7b56a1cf1dea66962 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:43.192929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d961aa-a801-4fb1-8f15-f29263f3455e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:43.193466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d961aa-a801-4fb1-8f15-f29263f3455e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:43.194372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d961aa-a801-4fb1-8f15-f29263f3455e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:43.207960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dde1e-e6ea-4334-9a1e-6fe89f35b471 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:43.276070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-94d961aa-a801-4fb1-8f15-f29263f3455e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:43.284594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-94d961aa-a801-4fb1-8f15-f29263f3455e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:43.415968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6e3c-7d5a-4eca-998d-39ae1935c534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:43.418170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6e3c-7d5a-4eca-998d-39ae1935c534 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:43.418609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6e3c-7d5a-4eca-998d-39ae1935c534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:43.421303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6e3c-7d5a-4eca-998d-39ae1935c534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:43.429884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-594d6e3c-7d5a-4eca-998d-39ae1935c534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:43.504360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 818/1644] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:32:43.518395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21e148-c103-4ac2-9c87-b8da25de2eeb None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:43.518719 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21e148-c103-4ac2-9c87-b8da25de2eeb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:43.519003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21e148-c103-4ac2-9c87-b8da25de2eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:43.616296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ab21e148-c103-4ac2-9c87-b8da25de2eeb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:43.617959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ab21e148-c103-4ac2-9c87-b8da25de2eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:43.644253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 819/1645] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:32:43.651120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21e148-c103-4ac2-9c87-b8da25de2eeb None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:43.669843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21e148-c103-4ac2-9c87-b8da25de2eeb None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:43.682914 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6e3c-7d5a-4eca-998d-39ae1935c534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:43.684439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5be15-1b46-49d3-b8e4-0f248a12f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:43.685099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5be15-1b46-49d3-b8e4-0f248a12f381 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:43.693126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6e3c-7d5a-4eca-998d-39ae1935c534 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:43.693519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5be15-1b46-49d3-b8e4-0f248a12f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:43.694010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5be15-1b46-49d3-b8e4-0f248a12f381 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:43.695635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5be15-1b46-49d3-b8e4-0f248a12f381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:43.695859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5be15-1b46-49d3-b8e4-0f248a12f381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:43.701142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5be15-1b46-49d3-b8e4-0f248a12f381 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:43.719989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 827/1646] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:43.773266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6e3c-7d5a-4eca-998d-39ae1935c534 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:43.776256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 820/1647] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:32:43.787247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6e3c-7d5a-4eca-998d-39ae1935c534 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:43.806025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf0d06-a692-4d6e-8b01-ca62d2d95436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:43.806695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf0d06-a692-4d6e-8b01-ca62d2d95436 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:43.806982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf0d06-a692-4d6e-8b01-ca62d2d95436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:43.807378 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf0d06-a692-4d6e-8b01-ca62d2d95436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:43.807940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf0d06-a692-4d6e-8b01-ca62d2d95436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:43.810084 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf0d06-a692-4d6e-8b01-ca62d2d95436 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:43.900434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 828/1648] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:43 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:43.904779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5be15-1b46-49d3-b8e4-0f248a12f381 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:43.953891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5be15-1b46-49d3-b8e4-0f248a12f381 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:44.213498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13b2d-6aad-4325-9121-19278df6d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:44.217432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13b2d-6aad-4325-9121-19278df6d976 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:44.217432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13b2d-6aad-4325-9121-19278df6d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:44.217432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13b2d-6aad-4325-9121-19278df6d976 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:44.221564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c13b2d-6aad-4325-9121-19278df6d976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:44.224646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c13b2d-6aad-4325-9121-19278df6d976 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:44.298294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 821/1649] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:43 2022] POST /identity/v3/users => generated 293 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:44.308529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf0d06-a692-4d6e-8b01-ca62d2d95436 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:44.328291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf0d06-a692-4d6e-8b01-ca62d2d95436 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:44.348852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823e411-8372-42cf-875a-d13d57946281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:44.349600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823e411-8372-42cf-875a-d13d57946281 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:44.350504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823e411-8372-42cf-875a-d13d57946281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:44.350813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823e411-8372-42cf-875a-d13d57946281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:44.351514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823e411-8372-42cf-875a-d13d57946281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:44.359405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823e411-8372-42cf-875a-d13d57946281 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:44.408015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 829/1650] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:44.409327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13b2d-6aad-4325-9121-19278df6d976 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:44.438814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13b2d-6aad-4325-9121-19278df6d976 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:44.454254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dab3e-4080-4176-973c-0c647ae4482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:44.458474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dab3e-4080-4176-973c-0c647ae4482c admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:44.459725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dab3e-4080-4176-973c-0c647ae4482c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:44.460485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dab3e-4080-4176-973c-0c647ae4482c admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:44.463719 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dab3e-4080-4176-973c-0c647ae4482c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:44.473762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dab3e-4080-4176-973c-0c647ae4482c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:44.551222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 822/1651] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:44.557196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823e411-8372-42cf-875a-d13d57946281 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:44.628005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823e411-8372-42cf-875a-d13d57946281 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:44.653276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc9a08-51dd-45c3-a454-7cb1386f3e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:44.654575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc9a08-51dd-45c3-a454-7cb1386f3e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:44.657918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc9a08-51dd-45c3-a454-7cb1386f3e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:44.658388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc9a08-51dd-45c3-a454-7cb1386f3e5e admin admin] PATH_INFO: `/v3/projects/8f96964f88b643b8a6f40b54f2fa7df3/users/4b26ca9903574a0ebd9719faea34e336/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:44.726722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc9a08-51dd-45c3-a454-7cb1386f3e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f96964f88b643b8a6f40b54f2fa7df3, user_id=4b26ca9903574a0ebd9719faea34e336, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:44.732786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc9a08-51dd-45c3-a454-7cb1386f3e5e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:44.802765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 830/1652] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:44 2022] PUT /identity/v3/projects/8f96964f88b643b8a6f40b54f2fa7df3/users/4b26ca9903574a0ebd9719faea34e336/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:32:44.805973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a5a2e-32da-4d66-b629-97c43314dc26 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:44.806257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a5a2e-32da-4d66-b629-97c43314dc26 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:44.806527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a5a2e-32da-4d66-b629-97c43314dc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:44.876501 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9b8a5a2e-32da-4d66-b629-97c43314dc26 None None] MFA Rules not processed for user `4b26ca9903574a0ebd9719faea34e336`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:44.877826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9b8a5a2e-32da-4d66-b629-97c43314dc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:44.993265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:45.083357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 823/1653] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:45.090954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc9a08-51dd-45c3-a454-7cb1386f3e5e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:45.234562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:45.274443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc9a08-51dd-45c3-a454-7cb1386f3e5e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:45.294595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070206-8251-4397-a307-7d2d26e8ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:45.295913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070206-8251-4397-a307-7d2d26e8ee1b admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:45.296363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070206-8251-4397-a307-7d2d26e8ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:45.297058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070206-8251-4397-a307-7d2d26e8ee1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:45.298200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33070206-8251-4397-a307-7d2d26e8ee1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:45.302213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33070206-8251-4397-a307-7d2d26e8ee1b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:45.414688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 831/1654] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:45 2022] POST /identity/v3/projects => generated 385 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:45.415804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a5a2e-32da-4d66-b629-97c43314dc26 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:45.433753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a5a2e-32da-4d66-b629-97c43314dc26 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:45.598598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07557f16-129b-42b2-9756-ea487a66ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:45.599505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07557f16-129b-42b2-9756-ea487a66ed40 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:45.599964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07557f16-129b-42b2-9756-ea487a66ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:45.600253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07557f16-129b-42b2-9756-ea487a66ed40 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:45.601025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07557f16-129b-42b2-9756-ea487a66ed40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:45.603086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07557f16-129b-42b2-9756-ea487a66ed40 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:45.673075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070206-8251-4397-a307-7d2d26e8ee1b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:45.675335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 824/1655] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:45 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:45.692552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070206-8251-4397-a307-7d2d26e8ee1b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:45.709823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867c05d-dbe0-474a-8b4e-496d1bbcbd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:45.710471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867c05d-dbe0-474a-8b4e-496d1bbcbd90 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:45.711094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867c05d-dbe0-474a-8b4e-496d1bbcbd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:45.711535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867c05d-dbe0-474a-8b4e-496d1bbcbd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:45.712833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867c05d-dbe0-474a-8b4e-496d1bbcbd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:45.715119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867c05d-dbe0-474a-8b4e-496d1bbcbd90 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:45.748179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 832/1656] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:45.758916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07557f16-129b-42b2-9756-ea487a66ed40 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:45.793323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07557f16-129b-42b2-9756-ea487a66ed40 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:45.812596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596541b1-5b6e-4300-b12f-41042173ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:45.814370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596541b1-5b6e-4300-b12f-41042173ea48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:45.815050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596541b1-5b6e-4300-b12f-41042173ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:45.815644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596541b1-5b6e-4300-b12f-41042173ea48 admin admin] PATH_INFO: `/v3/projects/bb1b580f108b46ff9cf1d6ffa7a30da4/users/13d4e9a88f034f06be058533a07f0175/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:45.859937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596541b1-5b6e-4300-b12f-41042173ea48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1b580f108b46ff9cf1d6ffa7a30da4, user_id=13d4e9a88f034f06be058533a07f0175, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:45.863018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596541b1-5b6e-4300-b12f-41042173ea48 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:45.888235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 825/1657] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:45 2022] PUT /identity/v3/projects/bb1b580f108b46ff9cf1d6ffa7a30da4/users/13d4e9a88f034f06be058533a07f0175/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:45.894174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867c05d-dbe0-474a-8b4e-496d1bbcbd90 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:45.919020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867c05d-dbe0-474a-8b4e-496d1bbcbd90 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:46.151864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287114f-191c-4180-8aba-6db845d75e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:46.156558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287114f-191c-4180-8aba-6db845d75e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:46.159398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287114f-191c-4180-8aba-6db845d75e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:46.160150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287114f-191c-4180-8aba-6db845d75e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:46.167059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287114f-191c-4180-8aba-6db845d75e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:46.186783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287114f-191c-4180-8aba-6db845d75e91 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:46.233351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 833/1658] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:46.238290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596541b1-5b6e-4300-b12f-41042173ea48 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:46.262257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287114f-191c-4180-8aba-6db845d75e91 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:46.264307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c287114f-191c-4180-8aba-6db845d75e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:46.293356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287114f-191c-4180-8aba-6db845d75e91 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:46.304947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596541b1-5b6e-4300-b12f-41042173ea48 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:46.307170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:46.309850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:46.310135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:46.310441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] PATH_INFO: `/v3/projects/2756fd68c251459dac37e4ef4f6ae8e0` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:46.315885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2756fd68c251459dac37e4ef4f6ae8e0)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:46.317504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:32:46.317504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 03:32:46.317504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: Aug 24 03:32:46.321007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:46.339752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beced924-7873-4337-b8ab-6aed01932df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:46.342600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beced924-7873-4337-b8ab-6aed01932df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:46.352752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beced924-7873-4337-b8ab-6aed01932df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:46.353860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beced924-7873-4337-b8ab-6aed01932df7 admin admin] PATH_INFO: `/v3/projects/bb1b580f108b46ff9cf1d6ffa7a30da4/users/13d4e9a88f034f06be058533a07f0175/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:46.361571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beced924-7873-4337-b8ab-6aed01932df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1b580f108b46ff9cf1d6ffa7a30da4, user_id=13d4e9a88f034f06be058533a07f0175, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:46.373427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beced924-7873-4337-b8ab-6aed01932df7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:46.430802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 826/1659] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:46 2022] PUT /identity/v3/projects/bb1b580f108b46ff9cf1d6ffa7a30da4/users/13d4e9a88f034f06be058533a07f0175/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:46.432479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beced924-7873-4337-b8ab-6aed01932df7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:46.435336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-beced924-7873-4337-b8ab-6aed01932df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:46.534488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2756fd68c251459dac37e4ef4f6ae8e0', 'request_id': 'req-a46a3c57-3bf2-4081-b137-e1d7018c97d1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:46.557828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2756fd68c251459dac37e4ef4f6ae8e0', 'request_id': 'req-a46a3c57-3bf2-4081-b137-e1d7018c97d1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:46.621044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2756fd68c251459dac37e4ef4f6ae8e0', 'request_id': 'req-a46a3c57-3bf2-4081-b137-e1d7018c97d1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:46.689576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] The token cache is being invalidate because project 2756fd68c251459dac37e4ef4f6ae8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:32:46.689969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beced924-7873-4337-b8ab-6aed01932df7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:46.690154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:46.690154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a46a3c57-3bf2-4081-b137-e1d7018c97d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:46.690154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 834/1660] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:32:46 2022] DELETE /identity/v3/projects/2756fd68c251459dac37e4ef4f6ae8e0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:46.690564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25e8f-22d2-4f60-885e-47073bc0b8d1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:46.690866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25e8f-22d2-4f60-885e-47073bc0b8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:46.691601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25e8f-22d2-4f60-885e-47073bc0b8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:46.801086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-15d25e8f-22d2-4f60-885e-47073bc0b8d1 None None] MFA Rules not processed for user `13d4e9a88f034f06be058533a07f0175`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:46.808234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-15d25e8f-22d2-4f60-885e-47073bc0b8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:46.868018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:46.938864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:47.042548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:47.043546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:47.043966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:47.044372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] PATH_INFO: `/v3/users/aaeb70714612431bbcd63f1105ff9ae5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:47.053518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaeb70714612431bbcd63f1105ff9ae5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:47.060351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:47.069200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 835/1661] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:47.072478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b1ac7-2d03-48cb-810d-98c4bacb6bc0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:47.072920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b1ac7-2d03-48cb-810d-98c4bacb6bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:47.073196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b1ac7-2d03-48cb-810d-98c4bacb6bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:47.145130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-491b1ac7-2d03-48cb-810d-98c4bacb6bc0 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:47.150262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-491b1ac7-2d03-48cb-810d-98c4bacb6bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:47.174503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 836/1662] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:47.175743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b1ac7-2d03-48cb-810d-98c4bacb6bc0 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:47.182420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-491b1ac7-2d03-48cb-810d-98c4bacb6bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:47.377714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaeb70714612431bbcd63f1105ff9ae5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:47.381875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaeb70714612431bbcd63f1105ff9ae5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:47.383259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaeb70714612431bbcd63f1105ff9ae5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:47.425472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaeb70714612431bbcd63f1105ff9ae5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:47.435668 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b1ac7-2d03-48cb-810d-98c4bacb6bc0 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:47.449070 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01323d-9424-4e30-a44b-8e234347810b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:47.450080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01323d-9424-4e30-a44b-8e234347810b service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:47.450895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01323d-9424-4e30-a44b-8e234347810b service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:47.451408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01323d-9424-4e30-a44b-8e234347810b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:47.461208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0a01323d-9424-4e30-a44b-8e234347810b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:47.484747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01323d-9424-4e30-a44b-8e234347810b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:47.486543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01323d-9424-4e30-a44b-8e234347810b service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:47.499740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 837/1663] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:47.501692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2fab1-e6c1-4f4f-92c6-0717140cccee None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:47.502154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2fab1-e6c1-4f4f-92c6-0717140cccee None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:47.502574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2fab1-e6c1-4f4f-92c6-0717140cccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:47.512120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8c900066-8b9e-463d-97b3-d0fee1fd77fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaeb70714612431bbcd63f1105ff9ae5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:47.560836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 827/1664] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:32:46 2022] DELETE /identity/v3/users/aaeb70714612431bbcd63f1105ff9ae5 => generated 0 bytes in 1129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:47.567002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dbb18-a2a0-4995-958c-70216bdbde23 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:47.567498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dbb18-a2a0-4995-958c-70216bdbde23 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:47.567957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dbb18-a2a0-4995-958c-70216bdbde23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:47.569518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c2e2fab1-e6c1-4f4f-92c6-0717140cccee None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:47.572814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c2e2fab1-e6c1-4f4f-92c6-0717140cccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:47.636343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c86dbb18-a2a0-4995-958c-70216bdbde23 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:47.642790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c86dbb18-a2a0-4995-958c-70216bdbde23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:47.835649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 838/1665] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:47.837468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2fab1-e6c1-4f4f-92c6-0717140cccee None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:47.841741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c2e2fab1-e6c1-4f4f-92c6-0717140cccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:47.871093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2fab1-e6c1-4f4f-92c6-0717140cccee None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:47.882177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:47.883875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:47.884338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:47.884930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] PATH_INFO: `/v3/users/4b26ca9903574a0ebd9719faea34e336` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:47.887654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b26ca9903574a0ebd9719faea34e336)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:47.892705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:47.910778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 828/1666] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:32:47.920488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae69dc-7826-4003-b5bb-5f7b8418a962 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:47.921206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae69dc-7826-4003-b5bb-5f7b8418a962 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:47.922710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae69dc-7826-4003-b5bb-5f7b8418a962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:48.089475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-92ae69dc-7826-4003-b5bb-5f7b8418a962 None None] MFA Rules not processed for user `1507cffe84dc4849a7040333ad48d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:48.091508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92ae69dc-7826-4003-b5bb-5f7b8418a962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:48.216440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:48.252888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b26ca9903574a0ebd9719faea34e336'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:48.254510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b26ca9903574a0ebd9719faea34e336'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:48.273423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:48.278318 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 829/1667] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:48.281578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae69dc-7826-4003-b5bb-5f7b8418a962 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:48.308124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b26ca9903574a0ebd9719faea34e336'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:48.311930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae69dc-7826-4003-b5bb-5f7b8418a962 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:48.325366 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:48.326118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:48.326439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:48.326843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:48.329751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b26ca9903574a0ebd9719faea34e336'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:48.331303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:48.331792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:48.333741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:48.374627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 830/1668] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:32:48.374627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:48.375192 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b26ca9903574a0ebd9719faea34e336'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:48.376834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:48.399541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 839/1669] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:32:47 2022] DELETE /identity/v3/users/4b26ca9903574a0ebd9719faea34e336 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:48.401770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:48.404398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:48.572426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c998c1-1dfa-4577-b226-4098ce08c27d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:48.640325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de81dd-004c-471d-943e-5f8b03e28941 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:48.664400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:48.665045 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:48.665329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:48.665604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:48.690515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:48.735730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6473ce2-5322-4d3e-85b7-9b31a359ff1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:48.736386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473ce2-5322-4d3e-85b7-9b31a359ff1d service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:48.736665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473ce2-5322-4d3e-85b7-9b31a359ff1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:48.736940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473ce2-5322-4d3e-85b7-9b31a359ff1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:48.740738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b6473ce2-5322-4d3e-85b7-9b31a359ff1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:48.839682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:48.851067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:48.888775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6473ce2-5322-4d3e-85b7-9b31a359ff1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:48.891483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6473ce2-5322-4d3e-85b7-9b31a359ff1d service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:48.908637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 840/1670] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:48.909768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:48.910125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 831/1671] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:48.911829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143a8ac-42f0-4581-a206-7efdd7ee1dfb None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:48.912406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143a8ac-42f0-4581-a206-7efdd7ee1dfb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:48.913045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143a8ac-42f0-4581-a206-7efdd7ee1dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:48.917805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:48.937421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1143a8ac-42f0-4581-a206-7efdd7ee1dfb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:48.939479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1143a8ac-42f0-4581-a206-7efdd7ee1dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:48.951629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 832/1672] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:48.969562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d7d12-dd71-4439-ad12-a9a2f53f7151 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:48.979982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc0bc-dcb0-4c47-9baa-7f29ff6db07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:48.980632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc0bc-dcb0-4c47-9baa-7f29ff6db07c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:48.980918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc0bc-dcb0-4c47-9baa-7f29ff6db07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:48.981193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc0bc-dcb0-4c47-9baa-7f29ff6db07c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:48.981863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fc0bc-dcb0-4c47-9baa-7f29ff6db07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:48.983904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fc0bc-dcb0-4c47-9baa-7f29ff6db07c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:49.067783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 841/1673] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:48 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:49.073905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143a8ac-42f0-4581-a206-7efdd7ee1dfb None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:49.113337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143a8ac-42f0-4581-a206-7efdd7ee1dfb None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:49.221808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:49.271763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc0bc-dcb0-4c47-9baa-7f29ff6db07c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:49.274536 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a97fc0bc-dcb0-4c47-9baa-7f29ff6db07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:49.326249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa892c71-146f-4706-9cef-3da3bbe51f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:49.329739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892c71-146f-4706-9cef-3da3bbe51f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:49.330010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892c71-146f-4706-9cef-3da3bbe51f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:49.333384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892c71-146f-4706-9cef-3da3bbe51f41 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:49.337579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa892c71-146f-4706-9cef-3da3bbe51f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:49.345962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa892c71-146f-4706-9cef-3da3bbe51f41 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:49.408520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 833/1674] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:49 2022] POST /identity/v3/users => generated 303 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:49.414955 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa892c71-146f-4706-9cef-3da3bbe51f41 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:49.433029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa892c71-146f-4706-9cef-3da3bbe51f41 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:49.444777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a1493-41d9-4f54-8947-f97c22ddacb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:49.445479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a1493-41d9-4f54-8947-f97c22ddacb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:49.445753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a1493-41d9-4f54-8947-f97c22ddacb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:49.446021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a1493-41d9-4f54-8947-f97c22ddacb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:49.450181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a1493-41d9-4f54-8947-f97c22ddacb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:49.456364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a1493-41d9-4f54-8947-f97c22ddacb3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:49.485273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 834/1675] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:32:49.485986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:49.492310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a1493-41d9-4f54-8947-f97c22ddacb3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:49.509628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc0bc-dcb0-4c47-9baa-7f29ff6db07c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:49.522811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c45eb-01a1-4a1d-a09d-950ee4916d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:49.534905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c45eb-01a1-4a1d-a09d-950ee4916d2a service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:49.536658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c45eb-01a1-4a1d-a09d-950ee4916d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:49.542939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c45eb-01a1-4a1d-a09d-950ee4916d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:49.546350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a1493-41d9-4f54-8947-f97c22ddacb3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:49.569666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b535b-2abf-41c8-b707-d2fcd2f9a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:49.570860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b535b-2abf-41c8-b707-d2fcd2f9a5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:49.573112 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b535b-2abf-41c8-b707-d2fcd2f9a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:49.574082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b535b-2abf-41c8-b707-d2fcd2f9a5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:49.574227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b535b-2abf-41c8-b707-d2fcd2f9a5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:49.586067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b535b-2abf-41c8-b707-d2fcd2f9a5cf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:49.593817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c45eb-01a1-4a1d-a09d-950ee4916d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:49.598220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c45eb-01a1-4a1d-a09d-950ee4916d2a service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:49.653020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 835/1677] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:49.653217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 842/1677] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:32:49.657894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c45eb-01a1-4a1d-a09d-950ee4916d2a service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:49.723403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c45eb-01a1-4a1d-a09d-950ee4916d2a service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:49.747801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce91a53-1485-44a8-ae3f-48a51d376c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:49.750061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce91a53-1485-44a8-ae3f-48a51d376c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:49.751713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce91a53-1485-44a8-ae3f-48a51d376c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:49.753384 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce91a53-1485-44a8-ae3f-48a51d376c00 admin admin] PATH_INFO: `/v3/projects/4634505bfff74f40a34bd82c6cd674e7/users/f85c35c69cf54b4eb53db629dac09aa6/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:49.812151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce91a53-1485-44a8-ae3f-48a51d376c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4634505bfff74f40a34bd82c6cd674e7, user_id=f85c35c69cf54b4eb53db629dac09aa6, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:49.827678 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce91a53-1485-44a8-ae3f-48a51d376c00 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:49.873119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 843/1678] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:49 2022] PUT /identity/v3/projects/4634505bfff74f40a34bd82c6cd674e7/users/f85c35c69cf54b4eb53db629dac09aa6/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:49.880226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b345c65-7784-483f-bfef-910f0f1ba496 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:49.880931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b345c65-7784-483f-bfef-910f0f1ba496 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:49.881486 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b345c65-7784-483f-bfef-910f0f1ba496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:49.983566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7b345c65-7784-483f-bfef-910f0f1ba496 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:50.002850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7b345c65-7784-483f-bfef-910f0f1ba496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:50.402574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 836/1679] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:32:50.479528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce91a53-1485-44a8-ae3f-48a51d376c00 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:50.755297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce91a53-1485-44a8-ae3f-48a51d376c00 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:50.800849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509a766-9b3c-459b-b0ec-a0d1898ba726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:50.803210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509a766-9b3c-459b-b0ec-a0d1898ba726 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:50.806870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509a766-9b3c-459b-b0ec-a0d1898ba726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:50.807553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509a766-9b3c-459b-b0ec-a0d1898ba726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:50.870605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509a766-9b3c-459b-b0ec-a0d1898ba726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:50.876189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509a766-9b3c-459b-b0ec-a0d1898ba726 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:50.932165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 844/1680] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:51.539868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec94b9-3996-4d33-873b-249555d9a0d2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:51.542536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec94b9-3996-4d33-873b-249555d9a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:51.543551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec94b9-3996-4d33-873b-249555d9a0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:51.719464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-aeec94b9-3996-4d33-873b-249555d9a0d2 None None] MFA Rules not processed for user `c8969ad404a44181b719c5546230c49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:51.722348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aeec94b9-3996-4d33-873b-249555d9a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:52.003982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 837/1681] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:52.006448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2aca-ffdb-4da3-8472-65fc93705299 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:52.008002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2aca-ffdb-4da3-8472-65fc93705299 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:52.008699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2aca-ffdb-4da3-8472-65fc93705299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:52.119348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ec1c2aca-ffdb-4da3-8472-65fc93705299 None None] MFA Rules not processed for user `c8969ad404a44181b719c5546230c49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:52.124511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ec1c2aca-ffdb-4da3-8472-65fc93705299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:52.149715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 845/1682] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:52.161436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec94b9-3996-4d33-873b-249555d9a0d2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:52.163286 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aeec94b9-3996-4d33-873b-249555d9a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:52.239073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:52.258369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2aca-ffdb-4da3-8472-65fc93705299 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:52.259980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ec1c2aca-ffdb-4da3-8472-65fc93705299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:52.312520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2aca-ffdb-4da3-8472-65fc93705299 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:52.361362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:52.362421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec94b9-3996-4d33-873b-249555d9a0d2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:52.362567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:52.362995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:52.363484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] PATH_INFO: `/v3/projects/8f96964f88b643b8a6f40b54f2fa7df3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:52.372318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f96964f88b643b8a6f40b54f2fa7df3)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:52.388451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:52.390297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9fd22-aee5-4b2a-8c27-972976c95fcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:52.391423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9fd22-aee5-4b2a-8c27-972976c95fcc service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:52.392010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9fd22-aee5-4b2a-8c27-972976c95fcc service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:52.392401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9fd22-aee5-4b2a-8c27-972976c95fcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:52.403669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9fd22-aee5-4b2a-8c27-972976c95fcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:52.406242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9fd22-aee5-4b2a-8c27-972976c95fcc service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:52.425523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 838/1683] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:32:52.687213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f96964f88b643b8a6f40b54f2fa7df3', 'request_id': 'req-17c84e29-1deb-4333-bd62-3607e669d46c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:52.745419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f96964f88b643b8a6f40b54f2fa7df3', 'request_id': 'req-17c84e29-1deb-4333-bd62-3607e669d46c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:52.781262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f96964f88b643b8a6f40b54f2fa7df3', 'request_id': 'req-17c84e29-1deb-4333-bd62-3607e669d46c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:52.842354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] The token cache is being invalidate because project 8f96964f88b643b8a6f40b54f2fa7df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:32:52.842752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:52.846078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:52.852578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 846/1684] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:32:52 2022] DELETE /identity/v3/projects/8f96964f88b643b8a6f40b54f2fa7df3 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:52.857835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9fd22-aee5-4b2a-8c27-972976c95fcc service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:52.907373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9fd22-aee5-4b2a-8c27-972976c95fcc service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:53.023210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:53.023902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:53.024483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:53.024854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] PATH_INFO: `/v3/users/13d4e9a88f034f06be058533a07f0175` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:53.026526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d4e9a88f034f06be058533a07f0175)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:53.032490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:53.116805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d4e9a88f034f06be058533a07f0175'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.116805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d4e9a88f034f06be058533a07f0175'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.116805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d4e9a88f034f06be058533a07f0175'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.153594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d4e9a88f034f06be058533a07f0175'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.167499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32f71a2c-a92b-4b24-868d-f20c43a5c93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d4e9a88f034f06be058533a07f0175'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.189585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 839/1685] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:32:52 2022] DELETE /identity/v3/users/13d4e9a88f034f06be058533a07f0175 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:53.598585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:53.603448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:53.640236 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84e29-1deb-4333-bd62-3607e669d46c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:53.730405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:53.762039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:53.764624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:53.764908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:53.765188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] PATH_INFO: `/v3/projects/a524a2006c9345f5a265d71322c1fc33` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:53.769913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a524a2006c9345f5a265d71322c1fc33)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:53.789527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:53.932599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a524a2006c9345f5a265d71322c1fc33', 'request_id': 'req-576abbbd-d366-42fa-8670-03adfe5abf1a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.948795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a524a2006c9345f5a265d71322c1fc33', 'request_id': 'req-576abbbd-d366-42fa-8670-03adfe5abf1a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.960593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a524a2006c9345f5a265d71322c1fc33', 'request_id': 'req-576abbbd-d366-42fa-8670-03adfe5abf1a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.976975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] The token cache is being invalidate because project a524a2006c9345f5a265d71322c1fc33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:32:53.977287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.978204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-576abbbd-d366-42fa-8670-03adfe5abf1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:53.980443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 847/1686] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:32:53 2022] DELETE /identity/v3/projects/a524a2006c9345f5a265d71322c1fc33 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:53.986128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736a564-9dcb-4e65-9061-352cab74aed0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:53.986693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736a564-9dcb-4e65-9061-352cab74aed0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:53.987370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736a564-9dcb-4e65-9061-352cab74aed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:54.051815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3736a564-9dcb-4e65-9061-352cab74aed0 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:54.054191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3736a564-9dcb-4e65-9061-352cab74aed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:54.144381 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b4691-74e8-4350-b7d5-555d4f967232 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:54.144848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b4691-74e8-4350-b7d5-555d4f967232 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:54.145368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b4691-74e8-4350-b7d5-555d4f967232 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:54.149170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 848/1687] 10.222.0.78 () {54 vars in 912 bytes} [Wed Aug 24 03:32:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:32:54.160486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e9c51-9f79-4d26-bdc9-5bb121858c8d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:54.161264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e9c51-9f79-4d26-bdc9-5bb121858c8d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:54.161639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e9c51-9f79-4d26-bdc9-5bb121858c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:54.180781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:54.247420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-219e9c51-9f79-4d26-bdc9-5bb121858c8d None None] MFA Rules not processed for user `0e7bc56706f2491b92f5745a0fbc2acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:54.250326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-219e9c51-9f79-4d26-bdc9-5bb121858c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:54.305123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 840/1688] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:54.324230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d04620-a488-4de5-b629-9801287ed950 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:54.324230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d04620-a488-4de5-b629-9801287ed950 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:54.324648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d04620-a488-4de5-b629-9801287ed950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:54.395401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-69d04620-a488-4de5-b629-9801287ed950 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:54.399823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-69d04620-a488-4de5-b629-9801287ed950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:54.448274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 841/1689] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:54.458775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d04620-a488-4de5-b629-9801287ed950 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:54.509604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d04620-a488-4de5-b629-9801287ed950 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:54.552312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:54.554889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:54.555777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:54.556524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:54.558423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:32:54.559730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 849/1690] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:32:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:32:54.581912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:54.584375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:54.633059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 842/1691] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:32:54.643151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e9c51-9f79-4d26-bdc9-5bb121858c8d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:54.665137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e9c51-9f79-4d26-bdc9-5bb121858c8d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:54.678545 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0984373-0df3-4388-8299-04fa745f093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:54.679492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0984373-0df3-4388-8299-04fa745f093a admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:54.679873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0984373-0df3-4388-8299-04fa745f093a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:54.680248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0984373-0df3-4388-8299-04fa745f093a admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:54.681017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0984373-0df3-4388-8299-04fa745f093a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:54.689737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0984373-0df3-4388-8299-04fa745f093a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:54.738492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:54.740983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:54.784018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b527ed-f70e-4e83-a7e0-2ee0c0f989b2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:54.791827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19fe07-7896-4b66-b99c-cf332d146f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:54.792572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19fe07-7896-4b66-b99c-cf332d146f15 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:54.792843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19fe07-7896-4b66-b99c-cf332d146f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:54.793120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19fe07-7896-4b66-b99c-cf332d146f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:54.819684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19fe07-7896-4b66-b99c-cf332d146f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:54.829974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19fe07-7896-4b66-b99c-cf332d146f15 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:54.833843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 850/1692] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:54 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:54.837071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0984373-0df3-4388-8299-04fa745f093a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:54.865801 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 843/1693] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:32:55.161260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:55.211642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0984373-0df3-4388-8299-04fa745f093a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:55.237000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780f8f0-23de-4edf-80c6-0b21ac0d4464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:55.238528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780f8f0-23de-4edf-80c6-0b21ac0d4464 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:55.241789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780f8f0-23de-4edf-80c6-0b21ac0d4464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:55.242498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780f8f0-23de-4edf-80c6-0b21ac0d4464 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:55.244039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780f8f0-23de-4edf-80c6-0b21ac0d4464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:55.252710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780f8f0-23de-4edf-80c6-0b21ac0d4464 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:55.345748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 851/1694] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:54 2022] POST /identity/v3/users => generated 283 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:55.348646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19fe07-7896-4b66-b99c-cf332d146f15 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:55.429612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19fe07-7896-4b66-b99c-cf332d146f15 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:55.459845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d22c-9f63-4de2-adee-134b5f995944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:55.461415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d22c-9f63-4de2-adee-134b5f995944 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:55.462142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d22c-9f63-4de2-adee-134b5f995944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:55.462871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d22c-9f63-4de2-adee-134b5f995944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:55.464207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d22c-9f63-4de2-adee-134b5f995944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:55.468226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d22c-9f63-4de2-adee-134b5f995944 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:55.525376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 844/1695] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:32:55.528015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780f8f0-23de-4edf-80c6-0b21ac0d4464 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:55.566497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780f8f0-23de-4edf-80c6-0b21ac0d4464 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:55.588043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6f4b7-f8cd-4988-84aa-6f9f14e94ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:55.589188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f4b7-f8cd-4988-84aa-6f9f14e94ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:55.589774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f4b7-f8cd-4988-84aa-6f9f14e94ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:55.590313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f4b7-f8cd-4988-84aa-6f9f14e94ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:55.595292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6f4b7-f8cd-4988-84aa-6f9f14e94ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:55.605396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6f4b7-f8cd-4988-84aa-6f9f14e94ff0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:55.643049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 852/1696] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:32:55.650688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d22c-9f63-4de2-adee-134b5f995944 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:55.722460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d22c-9f63-4de2-adee-134b5f995944 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:55.758361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b78490-1ac8-4b53-bc85-a693c34b9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:55.760167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b78490-1ac8-4b53-bc85-a693c34b9a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:55.761772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b78490-1ac8-4b53-bc85-a693c34b9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:55.764855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b78490-1ac8-4b53-bc85-a693c34b9a61 admin admin] PATH_INFO: `/v3/projects/d888fad119be48b8a24adf137770970e/users/b9c5a1a7334648ebb140ffdc6d3e72ff/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:55.955407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b78490-1ac8-4b53-bc85-a693c34b9a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d888fad119be48b8a24adf137770970e, user_id=b9c5a1a7334648ebb140ffdc6d3e72ff, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:55.972672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b78490-1ac8-4b53-bc85-a693c34b9a61 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:56.063702 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 845/1697] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:55 2022] PUT /identity/v3/projects/d888fad119be48b8a24adf137770970e/users/b9c5a1a7334648ebb140ffdc6d3e72ff/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:56.068023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32db3-25ce-4cb7-8a4f-5c624d8d431f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:56.069110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32db3-25ce-4cb7-8a4f-5c624d8d431f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:56.070511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32db3-25ce-4cb7-8a4f-5c624d8d431f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:56.244695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bba32db3-25ce-4cb7-8a4f-5c624d8d431f None None] MFA Rules not processed for user `b9c5a1a7334648ebb140ffdc6d3e72ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:56.254483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bba32db3-25ce-4cb7-8a4f-5c624d8d431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:56.301833 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc677f29-b7f7-4883-b7c9-a8192ea5e04c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:56.302298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc677f29-b7f7-4883-b7c9-a8192ea5e04c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:56.303200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc677f29-b7f7-4883-b7c9-a8192ea5e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:56.449907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fc677f29-b7f7-4883-b7c9-a8192ea5e04c None None] MFA Rules not processed for user `f85c35c69cf54b4eb53db629dac09aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:56.451229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fc677f29-b7f7-4883-b7c9-a8192ea5e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:56.636340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 853/1698] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:32:56.641422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32db3-25ce-4cb7-8a4f-5c624d8d431f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:56.707615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 846/1699] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:56 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:56.715057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7214813-404f-487c-8e54-6e5d54f417ec None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:56.717903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7214813-404f-487c-8e54-6e5d54f417ec None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:56.719536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7214813-404f-487c-8e54-6e5d54f417ec None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:56.728688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 847/1700] 10.222.0.78 () {54 vars in 961 bytes} [Wed Aug 24 03:32:56 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:32:56.731823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7214813-404f-487c-8e54-6e5d54f417ec None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:56.739550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e7214813-404f-487c-8e54-6e5d54f417ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:56.782284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32db3-25ce-4cb7-8a4f-5c624d8d431f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:56.789897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8490b54-1de1-4899-9915-7014db2d4dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:56.791174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8490b54-1de1-4899-9915-7014db2d4dac admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:56.791596 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8490b54-1de1-4899-9915-7014db2d4dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:56.792020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8490b54-1de1-4899-9915-7014db2d4dac admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:56.792905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8490b54-1de1-4899-9915-7014db2d4dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:56.797087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8490b54-1de1-4899-9915-7014db2d4dac admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:56.918506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 854/1701] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:56 2022] POST /identity/v3/projects => generated 363 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:32:56.923810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3651-ee46-4c7c-814e-f9582f492a21 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:56.924507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3651-ee46-4c7c-814e-f9582f492a21 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:56.929664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3651-ee46-4c7c-814e-f9582f492a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:56.951245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:56.980058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7214813-404f-487c-8e54-6e5d54f417ec None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:56.988996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5e9a3651-ee46-4c7c-814e-f9582f492a21 None None] MFA Rules not processed for user `496b8b8fa8ad4cc59b7f3d2c48cdd977`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:56.988996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5e9a3651-ee46-4c7c-814e-f9582f492a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:57.064408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:57.162063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d206ee-3ceb-4487-92be-f63862a287a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:57.162756 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d206ee-3ceb-4487-92be-f63862a287a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:57.163036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d206ee-3ceb-4487-92be-f63862a287a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:57.163306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d206ee-3ceb-4487-92be-f63862a287a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:57.164005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d206ee-3ceb-4487-92be-f63862a287a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:57.165967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d206ee-3ceb-4487-92be-f63862a287a0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:57.187226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 855/1702] 10.222.0.78 () {58 vars in 1058 bytes} [Wed Aug 24 03:32:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:57.192925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3651-ee46-4c7c-814e-f9582f492a21 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:57.197144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5e9a3651-ee46-4c7c-814e-f9582f492a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:57.232676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 848/1703] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:32:56 2022] POST /identity/v3/projects => generated 401 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:57.239397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d206ee-3ceb-4487-92be-f63862a287a0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:57.265472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3651-ee46-4c7c-814e-f9582f492a21 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:57.482799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d206ee-3ceb-4487-92be-f63862a287a0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:57.495223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e52779-6d0b-4b94-92e7-0d271844e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:57.496658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e52779-6d0b-4b94-92e7-0d271844e690 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:57.496985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e52779-6d0b-4b94-92e7-0d271844e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:57.497347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e52779-6d0b-4b94-92e7-0d271844e690 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:57.502190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e52779-6d0b-4b94-92e7-0d271844e690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:57.504397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e52779-6d0b-4b94-92e7-0d271844e690 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:57.559388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 849/1704] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:57 2022] POST /identity/v3/users => generated 288 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:57.560169 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:57.561328 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:57.562333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:57.563215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] PATH_INFO: `/v3/projects/bb1b580f108b46ff9cf1d6ffa7a30da4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:57.563438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f28ad-b6c1-4aba-bfe4-bea7cbd6b0b7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:57.563754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f28ad-b6c1-4aba-bfe4-bea7cbd6b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:57.565623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f28ad-b6c1-4aba-bfe4-bea7cbd6b0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:57.573373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1b580f108b46ff9cf1d6ffa7a30da4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:57.577787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:57.674434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5b0f28ad-b6c1-4aba-bfe4-bea7cbd6b0b7 None None] MFA Rules not processed for user `45285b561f424fde9297724c6768250d`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:57.676827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5b0f28ad-b6c1-4aba-bfe4-bea7cbd6b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:57.872531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1b580f108b46ff9cf1d6ffa7a30da4', 'request_id': 'req-1d448ae0-dedd-4da8-ad73-e6791bf28a18'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:57.917547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1b580f108b46ff9cf1d6ffa7a30da4', 'request_id': 'req-1d448ae0-dedd-4da8-ad73-e6791bf28a18'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:57.941703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1b580f108b46ff9cf1d6ffa7a30da4', 'request_id': 'req-1d448ae0-dedd-4da8-ad73-e6791bf28a18'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:57.984159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 850/1705] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:57.988887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f28ad-b6c1-4aba-bfe4-bea7cbd6b0b7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:58.004692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] The token cache is being invalidate because project bb1b580f108b46ff9cf1d6ffa7a30da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:32:58.005635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:58.007318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:58.017427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 856/1706] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:32:57 2022] DELETE /identity/v3/projects/bb1b580f108b46ff9cf1d6ffa7a30da4 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:58.018931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:58.024478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:58.027605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:58.292351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f28ad-b6c1-4aba-bfe4-bea7cbd6b0b7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:58.334831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d448ae0-dedd-4da8-ad73-e6791bf28a18 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:58.344309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5bc71-b52a-4525-8c5b-48ea03a3d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:58.346144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5bc71-b52a-4525-8c5b-48ea03a3d9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:58.346956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5bc71-b52a-4525-8c5b-48ea03a3d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:58.347441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5bc71-b52a-4525-8c5b-48ea03a3d9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:58.348700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5bc71-b52a-4525-8c5b-48ea03a3d9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:58.353425 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5bc71-b52a-4525-8c5b-48ea03a3d9c1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:58.428085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:58.437274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:58.438683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:58.439054 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:58.439386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:58.441676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:58.448537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 857/1707] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:32:58 2022] POST /identity/v3/users => generated 307 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:32:58.451011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5bc71-b52a-4525-8c5b-48ea03a3d9c1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:58.454520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-40d5bc71-b52a-4525-8c5b-48ea03a3d9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:58.456021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:58.457686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:58.483229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 851/1708] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:58.484244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:58.492009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:58.510872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5bc71-b52a-4525-8c5b-48ea03a3d9c1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:58.528161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490b13e-6564-4e6a-8b50-9cbbe40de44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:58.529339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490b13e-6564-4e6a-8b50-9cbbe40de44d admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:58.532106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490b13e-6564-4e6a-8b50-9cbbe40de44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:58.532106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490b13e-6564-4e6a-8b50-9cbbe40de44d admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:58.533231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490b13e-6564-4e6a-8b50-9cbbe40de44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:58.540789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490b13e-6564-4e6a-8b50-9cbbe40de44d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:58.580533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 858/1709] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:58.581975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36250a1b-e0ca-41de-923f-c020cb883df3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:58.583579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36250a1b-e0ca-41de-923f-c020cb883df3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:58.583579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36250a1b-e0ca-41de-923f-c020cb883df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:58.682619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-36250a1b-e0ca-41de-923f-c020cb883df3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:58.691019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-36250a1b-e0ca-41de-923f-c020cb883df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:58.703092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0ac3-82e7-4b14-9af1-0c26a5a09351 service placement] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:58.711065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 859/1710] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:58.715475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36250a1b-e0ca-41de-923f-c020cb883df3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:58.718133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-36250a1b-e0ca-41de-923f-c020cb883df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:58.731151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011fa36-c040-4a44-9a7e-f7632371044f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:58.732450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011fa36-c040-4a44-9a7e-f7632371044f service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:58.732850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011fa36-c040-4a44-9a7e-f7632371044f service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:58.733279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011fa36-c040-4a44-9a7e-f7632371044f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:58.741246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9011fa36-c040-4a44-9a7e-f7632371044f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:58.762702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36250a1b-e0ca-41de-923f-c020cb883df3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:58.780869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:58.781923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:58.783652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:58.785602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] PATH_INFO: `/v3/users/52bb5dfd3b5c474fbac63c5990ffd8ef` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:58.790971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52bb5dfd3b5c474fbac63c5990ffd8ef)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:58.799947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:58.915215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:59.051145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52bb5dfd3b5c474fbac63c5990ffd8ef'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:59.055213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52bb5dfd3b5c474fbac63c5990ffd8ef'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:59.068715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011fa36-c040-4a44-9a7e-f7632371044f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:59.086876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011fa36-c040-4a44-9a7e-f7632371044f service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:59.105041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52bb5dfd3b5c474fbac63c5990ffd8ef'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:59.110264 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 852/1711] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:32:59.115848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f2994-1253-43dc-8266-ae1867e1e18f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:59.116223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f2994-1253-43dc-8266-ae1867e1e18f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:59.116888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f2994-1253-43dc-8266-ae1867e1e18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:59.127728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52bb5dfd3b5c474fbac63c5990ffd8ef'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:59.171463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52bb5dfd3b5c474fbac63c5990ffd8ef'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:32:59.198470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 860/1712] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:32:58 2022] DELETE /identity/v3/users/52bb5dfd3b5c474fbac63c5990ffd8ef => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:59.198889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:59.200027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-752f2994-1253-43dc-8266-ae1867e1e18f None None] MFA Rules not processed for user `f447a34300944a5da25f6408f802f602`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:59.201494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-752f2994-1253-43dc-8266-ae1867e1e18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:59.202214 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:59.388176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7be47e-5614-4d91-989c-e53901a96c21 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:59.413143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084e5cb-3308-4730-a924-b55d6f21326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:59.414899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084e5cb-3308-4730-a924-b55d6f21326e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:59.415266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084e5cb-3308-4730-a924-b55d6f21326e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:59.416857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084e5cb-3308-4730-a924-b55d6f21326e admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:59.421478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084e5cb-3308-4730-a924-b55d6f21326e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:59.428898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084e5cb-3308-4730-a924-b55d6f21326e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:59.470911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 853/1713] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:59.470911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f2994-1253-43dc-8266-ae1867e1e18f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:59.471177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 861/1714] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:32:59.471345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16326d7-fe2f-49d4-b7e2-e3cfeeb18f98 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:59.474041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-752f2994-1253-43dc-8266-ae1867e1e18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:59.476748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16326d7-fe2f-49d4-b7e2-e3cfeeb18f98 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:59.477257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16326d7-fe2f-49d4-b7e2-e3cfeeb18f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:59.532584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f2994-1253-43dc-8266-ae1867e1e18f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:59.564674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e5f7a-59a7-48d3-a178-b94087c75ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:59.567455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e5f7a-59a7-48d3-a178-b94087c75ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:59.567849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e5f7a-59a7-48d3-a178-b94087c75ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:59.568536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e5f7a-59a7-48d3-a178-b94087c75ad8 admin admin] PATH_INFO: `/v3/projects/e0b3b6a1079c403a9b6e77a5f46e428b/users/1bf5c19c88094e36a6e072672d4019b8/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:59.571032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a16326d7-fe2f-49d4-b7e2-e3cfeeb18f98 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:59.573547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a16326d7-fe2f-49d4-b7e2-e3cfeeb18f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:59.596314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 862/1715] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:59.600113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa55b-ad10-424b-bb91-0ce93307d88b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:59.601709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa55b-ad10-424b-bb91-0ce93307d88b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:59.602310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa55b-ad10-424b-bb91-0ce93307d88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:59.622475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e5f7a-59a7-48d3-a178-b94087c75ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b3b6a1079c403a9b6e77a5f46e428b, user_id=1bf5c19c88094e36a6e072672d4019b8, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:59.626441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e5f7a-59a7-48d3-a178-b94087c75ad8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:59.651383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 854/1716] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:59 2022] PUT /identity/v3/projects/e0b3b6a1079c403a9b6e77a5f46e428b/users/1bf5c19c88094e36a6e072672d4019b8/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:59.652707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e5f7a-59a7-48d3-a178-b94087c75ad8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:59.676347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6f6fa55b-ad10-424b-bb91-0ce93307d88b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:32:59.677768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6f6fa55b-ad10-424b-bb91-0ce93307d88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:59.801553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:59.852345 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e5f7a-59a7-48d3-a178-b94087c75ad8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:32:59.860020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deb5a6-3d83-49fa-9a70-9a255b0df2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:32:59.862124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deb5a6-3d83-49fa-9a70-9a255b0df2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:32:59.863321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deb5a6-3d83-49fa-9a70-9a255b0df2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:32:59.863625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deb5a6-3d83-49fa-9a70-9a255b0df2bf admin admin] PATH_INFO: `/v3/projects/4281ea781e624b5c904c36baa572c6a1/users/1f5f828f41aa47cc8adbf84ae6d82e2a/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:32:59.870793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 863/1717] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:32:59.870793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fa55b-ad10-424b-bb91-0ce93307d88b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:32:59.873221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6f6fa55b-ad10-424b-bb91-0ce93307d88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:32:59.919655 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deb5a6-3d83-49fa-9a70-9a255b0df2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4281ea781e624b5c904c36baa572c6a1, user_id=1f5f828f41aa47cc8adbf84ae6d82e2a, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:32:59.927070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deb5a6-3d83-49fa-9a70-9a255b0df2bf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:32:59.963222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 855/1718] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:32:59 2022] PUT /identity/v3/projects/4281ea781e624b5c904c36baa572c6a1/users/1f5f828f41aa47cc8adbf84ae6d82e2a/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:32:59.964570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deb5a6-3d83-49fa-9a70-9a255b0df2bf admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:00.098899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:00.112241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fa55b-ad10-424b-bb91-0ce93307d88b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:00.202368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deb5a6-3d83-49fa-9a70-9a255b0df2bf admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:00.222167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93130d0-e781-4732-a44a-ce88e4b0ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:00.224058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93130d0-e781-4732-a44a-ce88e4b0ef8a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:00.224850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93130d0-e781-4732-a44a-ce88e4b0ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:00.225604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93130d0-e781-4732-a44a-ce88e4b0ef8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:00.232423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93130d0-e781-4732-a44a-ce88e4b0ef8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:00.233179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93130d0-e781-4732-a44a-ce88e4b0ef8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:00.236803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93130d0-e781-4732-a44a-ce88e4b0ef8a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:00.267007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 856/1719] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:00.269025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93130d0-e781-4732-a44a-ce88e4b0ef8a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:00.300863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93130d0-e781-4732-a44a-ce88e4b0ef8a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:00.314683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e57bb-8c2a-442e-ab4f-bbc3ae22b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:00.315716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e57bb-8c2a-442e-ab4f-bbc3ae22b1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:00.316198 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e57bb-8c2a-442e-ab4f-bbc3ae22b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:00.316670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e57bb-8c2a-442e-ab4f-bbc3ae22b1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:00.317625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e57bb-8c2a-442e-ab4f-bbc3ae22b1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:00.321849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e57bb-8c2a-442e-ab4f-bbc3ae22b1f2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:00.350515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 857/1720] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:00.357404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e57bb-8c2a-442e-ab4f-bbc3ae22b1f2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:00.361517 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-763e57bb-8c2a-442e-ab4f-bbc3ae22b1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:00.411331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77588ad9-6d05-4df8-8f34-db0f6e1cdfbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:00.414839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588ad9-6d05-4df8-8f34-db0f6e1cdfbb service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:00.417946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588ad9-6d05-4df8-8f34-db0f6e1cdfbb service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:00.418543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588ad9-6d05-4df8-8f34-db0f6e1cdfbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:00.564217 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e57bb-8c2a-442e-ab4f-bbc3ae22b1f2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:00.596978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884a009-d803-43de-9796-74a6560ffb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:00.599170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884a009-d803-43de-9796-74a6560ffb1e service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:00.602044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884a009-d803-43de-9796-74a6560ffb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:00.603696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884a009-d803-43de-9796-74a6560ffb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:00.657291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884a009-d803-43de-9796-74a6560ffb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:00.665287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884a009-d803-43de-9796-74a6560ffb1e service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:00.700695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77588ad9-6d05-4df8-8f34-db0f6e1cdfbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:00.706927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77588ad9-6d05-4df8-8f34-db0f6e1cdfbb service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:00.724001 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 858/1721] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:00.725037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884a009-d803-43de-9796-74a6560ffb1e service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:00.766807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 864/1722] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:32:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 900 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:00.775026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77588ad9-6d05-4df8-8f34-db0f6e1cdfbb service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:00.788209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884a009-d803-43de-9796-74a6560ffb1e service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:00.811761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3f18f-2498-4675-85f1-50e62a7aa77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:00.813124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f18f-2498-4675-85f1-50e62a7aa77e admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:00.813636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f18f-2498-4675-85f1-50e62a7aa77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:00.814120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f18f-2498-4675-85f1-50e62a7aa77e admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:00.820930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77588ad9-6d05-4df8-8f34-db0f6e1cdfbb service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:00.827794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3f18f-2498-4675-85f1-50e62a7aa77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:00.831669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6535371-1404-41e2-a16b-77aaf2815d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:00.832556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535371-1404-41e2-a16b-77aaf2815d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:00.833018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3f18f-2498-4675-85f1-50e62a7aa77e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:00.834342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535371-1404-41e2-a16b-77aaf2815d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:00.841318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535371-1404-41e2-a16b-77aaf2815d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:00.842270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6535371-1404-41e2-a16b-77aaf2815d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:00.851176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6535371-1404-41e2-a16b-77aaf2815d53 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:00.878887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 859/1723] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:00.880274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3f18f-2498-4675-85f1-50e62a7aa77e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:00.908366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:00.912139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3f18f-2498-4675-85f1-50e62a7aa77e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:00.925701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c218ff-0cee-46c0-8d35-cdbc245191b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:00.926689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c218ff-0cee-46c0-8d35-cdbc245191b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:00.927077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c218ff-0cee-46c0-8d35-cdbc245191b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:00.927762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c218ff-0cee-46c0-8d35-cdbc245191b6 admin admin] PATH_INFO: `/v3/projects/e0b3b6a1079c403a9b6e77a5f46e428b/users/1bf5c19c88094e36a6e072672d4019b8/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:00.930898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 865/1724] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:00 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:00.936079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a27102-68b2-412a-aebb-a519299e15db None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:00.937200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a27102-68b2-412a-aebb-a519299e15db None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:00.938890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a27102-68b2-412a-aebb-a519299e15db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:00.950979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c218ff-0cee-46c0-8d35-cdbc245191b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b3b6a1079c403a9b6e77a5f46e428b, user_id=1bf5c19c88094e36a6e072672d4019b8, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:00.956949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c218ff-0cee-46c0-8d35-cdbc245191b6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:00.993750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 860/1725] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:00 2022] PUT /identity/v3/projects/e0b3b6a1079c403a9b6e77a5f46e428b/users/1bf5c19c88094e36a6e072672d4019b8/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:00.995218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c218ff-0cee-46c0-8d35-cdbc245191b6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:01.019869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-25a27102-68b2-412a-aebb-a519299e15db None None] MFA Rules not processed for user `1507cffe84dc4849a7040333ad48d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:01.021666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-25a27102-68b2-412a-aebb-a519299e15db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:01.153194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 866/1726] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:01.154512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a27102-68b2-412a-aebb-a519299e15db None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:01.155552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c218ff-0cee-46c0-8d35-cdbc245191b6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:01.161391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff1908-db41-4708-ac3a-3fbaa349c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:01.166315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff1908-db41-4708-ac3a-3fbaa349c86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:01.166886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff1908-db41-4708-ac3a-3fbaa349c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:01.167414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff1908-db41-4708-ac3a-3fbaa349c86f admin admin] PATH_INFO: `/v3/projects/4281ea781e624b5c904c36baa572c6a1/users/1f5f828f41aa47cc8adbf84ae6d82e2a/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:01.170094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff1908-db41-4708-ac3a-3fbaa349c86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4281ea781e624b5c904c36baa572c6a1, user_id=1f5f828f41aa47cc8adbf84ae6d82e2a, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:01.176307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a27102-68b2-412a-aebb-a519299e15db None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:01.180605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff1908-db41-4708-ac3a-3fbaa349c86f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:01.195395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e5e38-6559-4d82-84fd-fc91ab5c96ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:01.196156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e5e38-6559-4d82-84fd-fc91ab5c96ac admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:01.196539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e5e38-6559-4d82-84fd-fc91ab5c96ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:01.197158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e5e38-6559-4d82-84fd-fc91ab5c96ac admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:01.197994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e5e38-6559-4d82-84fd-fc91ab5c96ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:01.200992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e5e38-6559-4d82-84fd-fc91ab5c96ac admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:01.207146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 861/1727] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:00 2022] PUT /identity/v3/projects/4281ea781e624b5c904c36baa572c6a1/users/1f5f828f41aa47cc8adbf84ae6d82e2a/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:01.208803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c82b-8cb1-49d7-b802-4914f3c61c5b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:01.209577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c82b-8cb1-49d7-b802-4914f3c61c5b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:01.210070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c82b-8cb1-49d7-b802-4914f3c61c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:01.245001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 867/1728] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:01 2022] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:01.247456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e5e38-6559-4d82-84fd-fc91ab5c96ac admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:01.282488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e5e38-6559-4d82-84fd-fc91ab5c96ac admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:01.285547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d3a5c82b-8cb1-49d7-b802-4914f3c61c5b None None] MFA Rules not processed for user `1bf5c19c88094e36a6e072672d4019b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:01.290004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d3a5c82b-8cb1-49d7-b802-4914f3c61c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:01.312163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:01.450960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5b5e-74c4-43e4-9ea9-3c2850028564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:01.453979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5b5e-74c4-43e4-9ea9-3c2850028564 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:01.454594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5b5e-74c4-43e4-9ea9-3c2850028564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:01.456753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5b5e-74c4-43e4-9ea9-3c2850028564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:01.457749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c5b5e-74c4-43e4-9ea9-3c2850028564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:01.464926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c5b5e-74c4-43e4-9ea9-3c2850028564 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:01.481168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 862/1729] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:01.495238 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5c82b-8cb1-49d7-b802-4914f3c61c5b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:01.499403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d3a5c82b-8cb1-49d7-b802-4914f3c61c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:01.505026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 868/1730] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:01.509756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5b5e-74c4-43e4-9ea9-3c2850028564 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:01.532253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5b5e-74c4-43e4-9ea9-3c2850028564 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:01.552104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e533162-486d-4492-9ea1-41a007600d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:01.553587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e533162-486d-4492-9ea1-41a007600d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:01.555974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e533162-486d-4492-9ea1-41a007600d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:01.556510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e533162-486d-4492-9ea1-41a007600d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:01.557504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e533162-486d-4492-9ea1-41a007600d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:01.562358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e533162-486d-4492-9ea1-41a007600d62 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:01.597959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 869/1731] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:01.599351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e533162-486d-4492-9ea1-41a007600d62 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:01.628052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e533162-486d-4492-9ea1-41a007600d62 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:01.638822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a4d62-2904-4743-9615-053d86b89328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:01.639809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a4d62-2904-4743-9615-053d86b89328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:01.642278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a4d62-2904-4743-9615-053d86b89328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:01.642932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a4d62-2904-4743-9615-053d86b89328 admin admin] PATH_INFO: `/v3/projects/e922bbef02874c8887f97d1805592347/users/8675810435b44e30a828c5c1cf8ae446/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:01.688804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a4d62-2904-4743-9615-053d86b89328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e922bbef02874c8887f97d1805592347, user_id=8675810435b44e30a828c5c1cf8ae446, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:01.690825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a4d62-2904-4743-9615-053d86b89328 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:01.692821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5c82b-8cb1-49d7-b802-4914f3c61c5b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:01.707913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee687fb-7377-4cb4-bf42-56672acb7623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:01.708476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee687fb-7377-4cb4-bf42-56672acb7623 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:01.710706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee687fb-7377-4cb4-bf42-56672acb7623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:01.711632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee687fb-7377-4cb4-bf42-56672acb7623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:01.751482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee687fb-7377-4cb4-bf42-56672acb7623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:01.757475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee687fb-7377-4cb4-bf42-56672acb7623 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:01.782698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 870/1732] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:01 2022] PUT /identity/v3/projects/e922bbef02874c8887f97d1805592347/users/8675810435b44e30a828c5c1cf8ae446/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:01.784357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 863/1733] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:01.794888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910b4fa-de14-4229-b816-2f69ff88c7f0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:01.795393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910b4fa-de14-4229-b816-2f69ff88c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:01.795664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910b4fa-de14-4229-b816-2f69ff88c7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:01.883216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6910b4fa-de14-4229-b816-2f69ff88c7f0 None None] MFA Rules not processed for user `8675810435b44e30a828c5c1cf8ae446`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:01.893759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6910b4fa-de14-4229-b816-2f69ff88c7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:01.920991 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee687fb-7377-4cb4-bf42-56672acb7623 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:01.978404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee687fb-7377-4cb4-bf42-56672acb7623 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:02.052508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:02.184310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2bc81-1b16-42b9-ae45-3ab0596bb9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:02.191398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2bc81-1b16-42b9-ae45-3ab0596bb9db service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:02.196650 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2bc81-1b16-42b9-ae45-3ab0596bb9db service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:02.198956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2bc81-1b16-42b9-ae45-3ab0596bb9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:02.215048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d9f2bc81-1b16-42b9-ae45-3ab0596bb9db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:02.229931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 871/1734] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:02.231830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910b4fa-de14-4229-b816-2f69ff88c7f0 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:02.477791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2bc81-1b16-42b9-ae45-3ab0596bb9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:02.482537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2bc81-1b16-42b9-ae45-3ab0596bb9db service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:02.505151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 864/1735] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:02.511258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910b4fa-de14-4229-b816-2f69ff88c7f0 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:02.530765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf5e2d-4c29-44cc-b831-9c2cab7c3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:02.531424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5e2d-4c29-44cc-b831-9c2cab7c3ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:02.531703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5e2d-4c29-44cc-b831-9c2cab7c3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:02.532071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5e2d-4c29-44cc-b831-9c2cab7c3ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:02.532741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf5e2d-4c29-44cc-b831-9c2cab7c3ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:02.540225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf5e2d-4c29-44cc-b831-9c2cab7c3ea8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:02.636756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 872/1736] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:02 2022] POST /identity/v3/projects => generated 381 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:02.645405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2bc81-1b16-42b9-ae45-3ab0596bb9db service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:02.668828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:02.691316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2bc81-1b16-42b9-ae45-3ab0596bb9db service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:02.929715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf5e2d-4c29-44cc-b831-9c2cab7c3ea8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:02.931868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-99bf5e2d-4c29-44cc-b831-9c2cab7c3ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:02.944853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d4233-1657-4d20-b22d-67b294a497b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:02.944853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4233-1657-4d20-b22d-67b294a497b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:02.949093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4233-1657-4d20-b22d-67b294a497b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:02.951913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4233-1657-4d20-b22d-67b294a497b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:02.956949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d4233-1657-4d20-b22d-67b294a497b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:02.963493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d4233-1657-4d20-b22d-67b294a497b7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:03.049633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 865/1737] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:02 2022] POST /identity/v3/users => generated 297 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:03.052194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d4233-1657-4d20-b22d-67b294a497b7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:03.085055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d4233-1657-4d20-b22d-67b294a497b7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:03.110309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d579d63-01ce-4679-9eab-0eda1e176302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:03.112175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d579d63-01ce-4679-9eab-0eda1e176302 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:03.112175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d579d63-01ce-4679-9eab-0eda1e176302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:03.112175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d579d63-01ce-4679-9eab-0eda1e176302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:03.112747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d579d63-01ce-4679-9eab-0eda1e176302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:03.119388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d579d63-01ce-4679-9eab-0eda1e176302 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:03.176693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 866/1738] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:33:03.179263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d579d63-01ce-4679-9eab-0eda1e176302 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:03.193326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf5e2d-4c29-44cc-b831-9c2cab7c3ea8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:03.208508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:03.209405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:03.209659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:03.209911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] PATH_INFO: `/v3/projects/89d5faf83a8745ef9a6897464f1b1d6c` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:03.210586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d579d63-01ce-4679-9eab-0eda1e176302 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:03.214502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d5faf83a8745ef9a6897464f1b1d6c)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:03.220232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:03.226242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4777eb-f239-4a4d-bfa2-4fec266a248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:03.228111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4777eb-f239-4a4d-bfa2-4fec266a248d admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:03.228393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4777eb-f239-4a4d-bfa2-4fec266a248d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:03.230733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4777eb-f239-4a4d-bfa2-4fec266a248d admin admin] PATH_INFO: `/v3/projects/5986b9446bb045158a79e402b3e8861b/users/f0fa1a46cd97466abfbdf43da55de995/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:03.291669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4777eb-f239-4a4d-bfa2-4fec266a248d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5986b9446bb045158a79e402b3e8861b, user_id=f0fa1a46cd97466abfbdf43da55de995, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:03.296472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4777eb-f239-4a4d-bfa2-4fec266a248d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:03.345575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 867/1739] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:03 2022] PUT /identity/v3/projects/5986b9446bb045158a79e402b3e8861b/users/f0fa1a46cd97466abfbdf43da55de995/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:03.352728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4777eb-f239-4a4d-bfa2-4fec266a248d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:03.388019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d5faf83a8745ef9a6897464f1b1d6c', 'request_id': 'req-32cbc70b-371c-4ce0-87d1-12a32732726c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:03.405558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d5faf83a8745ef9a6897464f1b1d6c', 'request_id': 'req-32cbc70b-371c-4ce0-87d1-12a32732726c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:03.422194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d5faf83a8745ef9a6897464f1b1d6c', 'request_id': 'req-32cbc70b-371c-4ce0-87d1-12a32732726c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:03.425818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:03.453662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] The token cache is being invalidate because project 89d5faf83a8745ef9a6897464f1b1d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:03.455589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:03.457402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32cbc70b-371c-4ce0-87d1-12a32732726c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:03.464532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 873/1740] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:02 2022] DELETE /identity/v3/projects/89d5faf83a8745ef9a6897464f1b1d6c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:03.464532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8eaee5-bb7d-4621-bb2f-7a8af81a3b3f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:03.468177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8eaee5-bb7d-4621-bb2f-7a8af81a3b3f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:03.468633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8eaee5-bb7d-4621-bb2f-7a8af81a3b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:03.542696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4777eb-f239-4a4d-bfa2-4fec266a248d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:03.633540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8c8eaee5-bb7d-4621-bb2f-7a8af81a3b3f None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:03.636874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8c8eaee5-bb7d-4621-bb2f-7a8af81a3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:03.726785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2cfa0-ed38-49e6-b344-8aeb554814b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:03.727421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2cfa0-ed38-49e6-b344-8aeb554814b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:03.727694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2cfa0-ed38-49e6-b344-8aeb554814b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:03.727961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2cfa0-ed38-49e6-b344-8aeb554814b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:03.728631 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2cfa0-ed38-49e6-b344-8aeb554814b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:03.733465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2cfa0-ed38-49e6-b344-8aeb554814b0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:03.758377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 868/1741] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:03.764577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2cfa0-ed38-49e6-b344-8aeb554814b0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:03.769976 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-52c2cfa0-ed38-49e6-b344-8aeb554814b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:03.794330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:03.811138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2cfa0-ed38-49e6-b344-8aeb554814b0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:03.828758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 874/1742] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:33:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:03.830111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8eaee5-bb7d-4621-bb2f-7a8af81a3b3f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:03.831777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8c8eaee5-bb7d-4621-bb2f-7a8af81a3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:03.833750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:03.839090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:03.840312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:03.840743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] PATH_INFO: `/v3/users/252873ea08e04dc8bad55fa0bcc1edd7` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:03.867523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=252873ea08e04dc8bad55fa0bcc1edd7)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:03.887332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:03.904992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8eaee5-bb7d-4621-bb2f-7a8af81a3b3f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:03.920196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4272f8-6bd6-4e83-82c7-b95363d746ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:03.920902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4272f8-6bd6-4e83-82c7-b95363d746ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:03.921175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4272f8-6bd6-4e83-82c7-b95363d746ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:03.921444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4272f8-6bd6-4e83-82c7-b95363d746ac admin admin] PATH_INFO: `/v3/projects/5986b9446bb045158a79e402b3e8861b/users/f0fa1a46cd97466abfbdf43da55de995/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:03.928252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4272f8-6bd6-4e83-82c7-b95363d746ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5986b9446bb045158a79e402b3e8861b, user_id=f0fa1a46cd97466abfbdf43da55de995, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:03.931648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4272f8-6bd6-4e83-82c7-b95363d746ac admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:03.981774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 875/1743] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:03 2022] PUT /identity/v3/projects/5986b9446bb045158a79e402b3e8861b/users/f0fa1a46cd97466abfbdf43da55de995/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:03.988312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69cdc0-d935-43ad-92b8-70ec4eb86c5b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:03.989316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69cdc0-d935-43ad-92b8-70ec4eb86c5b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:03.989316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69cdc0-d935-43ad-92b8-70ec4eb86c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:04.035274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252873ea08e04dc8bad55fa0bcc1edd7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:04.036382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252873ea08e04dc8bad55fa0bcc1edd7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:04.038866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252873ea08e04dc8bad55fa0bcc1edd7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:04.048618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9c69cdc0-d935-43ad-92b8-70ec4eb86c5b None None] MFA Rules not processed for user `f0fa1a46cd97466abfbdf43da55de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:04.050290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9c69cdc0-d935-43ad-92b8-70ec4eb86c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:04.087231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252873ea08e04dc8bad55fa0bcc1edd7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:04.116373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252873ea08e04dc8bad55fa0bcc1edd7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:04.171963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 869/1744] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:03 2022] DELETE /identity/v3/users/252873ea08e04dc8bad55fa0bcc1edd7 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:04.173522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:04.180823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:04.289326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 876/1745] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:04.298636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69cdc0-d935-43ad-92b8-70ec4eb86c5b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:04.300460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9c69cdc0-d935-43ad-92b8-70ec4eb86c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:04.445689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:04.518170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69cdc0-d935-43ad-92b8-70ec4eb86c5b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:04.529276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412df7-fec3-4339-ac73-549f368e43aa admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:04.538170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc8ae0-59c5-4d37-9246-0cbe1ad9eb59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:04.539245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc8ae0-59c5-4d37-9246-0cbe1ad9eb59 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:04.539791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc8ae0-59c5-4d37-9246-0cbe1ad9eb59 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:04.540165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc8ae0-59c5-4d37-9246-0cbe1ad9eb59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:04.550812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-acfc8ae0-59c5-4d37-9246-0cbe1ad9eb59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:04.757636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf514f4-3058-41b5-9101-a959d8309d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:04.759693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf514f4-3058-41b5-9101-a959d8309d55 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:04.760346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf514f4-3058-41b5-9101-a959d8309d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:04.760966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf514f4-3058-41b5-9101-a959d8309d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:04.763414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:04.768655 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc8ae0-59c5-4d37-9246-0cbe1ad9eb59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:04.771957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc8ae0-59c5-4d37-9246-0cbe1ad9eb59 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:04.804925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 870/1746] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:33:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:33:04.930457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf514f4-3058-41b5-9101-a959d8309d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:04.933238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf514f4-3058-41b5-9101-a959d8309d55 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:05.003458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 877/1747] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:33:05.686692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2ba16-1bb3-492e-a79b-f63ca34eaf29 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:05.687290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2ba16-1bb3-492e-a79b-f63ca34eaf29 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:05.687826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2ba16-1bb3-492e-a79b-f63ca34eaf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:05.833709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-abe2ba16-1bb3-492e-a79b-f63ca34eaf29 None None] MFA Rules not processed for user `45285b561f424fde9297724c6768250d`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:05.839617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-abe2ba16-1bb3-492e-a79b-f63ca34eaf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:06.430892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 871/1748] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 745 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:06.994540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf514f4-3058-41b5-9101-a959d8309d55 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:07.061247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf514f4-3058-41b5-9101-a959d8309d55 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:07.130352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421940c8-f435-4e85-a615-1672c13f8ee5 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0fa1a46cd97466abfbdf43da55de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5986b9446bb045158a79e402b3e8861b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:07.132641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421940c8-f435-4e85-a615-1672c13f8ee5 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:07.132979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421940c8-f435-4e85-a615-1672c13f8ee5 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:07.133492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421940c8-f435-4e85-a615-1672c13f8ee5 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:07.134914 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421940c8-f435-4e85-a615-1672c13f8ee5 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:07.135467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421940c8-f435-4e85-a615-1672c13f8ee5 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:07.158451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421940c8-f435-4e85-a615-1672c13f8ee5 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:07.214258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 878/1749] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:07.217651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2ba16-1bb3-492e-a79b-f63ca34eaf29 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:07.239372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2ba16-1bb3-492e-a79b-f63ca34eaf29 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:07.288310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a32fc-ed9f-4b3d-8948-b7568d02420d tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0fa1a46cd97466abfbdf43da55de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5986b9446bb045158a79e402b3e8861b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:07.299609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a32fc-ed9f-4b3d-8948-b7568d02420d tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:07.303339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a32fc-ed9f-4b3d-8948-b7568d02420d tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:07.305916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a32fc-ed9f-4b3d-8948-b7568d02420d tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:07.308548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a32fc-ed9f-4b3d-8948-b7568d02420d tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:07.333033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a32fc-ed9f-4b3d-8948-b7568d02420d tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:07.591757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421940c8-f435-4e85-a615-1672c13f8ee5 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:07.598752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 872/1750] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:07 2022] POST /identity/v3/projects => generated 354 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:07.611919 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421940c8-f435-4e85-a615-1672c13f8ee5 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:07.921044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0fa1a46cd97466abfbdf43da55de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5986b9446bb045158a79e402b3e8861b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:07.925743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:07.925848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:07.926144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:07.930211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:07.930824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:07.932856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:07.986568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 879/1751] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:33:08.138433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a32fc-ed9f-4b3d-8948-b7568d02420d tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:08.155803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a32fc-ed9f-4b3d-8948-b7568d02420d tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:08.173334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0fa1a46cd97466abfbdf43da55de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5986b9446bb045158a79e402b3e8861b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:08.174141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:08.174497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:08.175017 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] PATH_INFO: `/v3/projects/54b61bc1a62c489383506c9717ec6efb` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:08.176735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=54b61bc1a62c489383506c9717ec6efb)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:08.179351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:08.352030 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b61bc1a62c489383506c9717ec6efb', 'request_id': 'req-14918d8a-faf5-4733-abff-149c5b397762'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:08.368120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b61bc1a62c489383506c9717ec6efb', 'request_id': 'req-14918d8a-faf5-4733-abff-149c5b397762'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:08.396394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b61bc1a62c489383506c9717ec6efb', 'request_id': 'req-14918d8a-faf5-4733-abff-149c5b397762'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:08.435419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] The token cache is being invalidate because project 54b61bc1a62c489383506c9717ec6efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:08.435654 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:08.443424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-14918d8a-faf5-4733-abff-149c5b397762 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:08.446902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 873/1752] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:08 2022] DELETE /identity/v3/projects/54b61bc1a62c489383506c9717ec6efb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:09.389363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:09.391690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:09.457222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc988-8416-4d9d-b217-16f7cfaacf3b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:09.457869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc988-8416-4d9d-b217-16f7cfaacf3b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:09.457869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc988-8416-4d9d-b217-16f7cfaacf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:09.533369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:09.540163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d2ecc988-8416-4d9d-b217-16f7cfaacf3b None None] MFA Rules not processed for user `0e7bc56706f2491b92f5745a0fbc2acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:09.551007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d2ecc988-8416-4d9d-b217-16f7cfaacf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:09.755925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a395-afac-4ff5-ad6e-229544b987a4 tempest-VolumeQuotaClassesTest-1111150596 tempest-VolumeQuotaClassesTest-1111150596-project-admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:09.924491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:09.925389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:09.925654 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 874/1753] 10.222.0.79 () {58 vars in 1015 bytes} [Wed Aug 24 03:33:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:09.925812 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:09.926071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] PATH_INFO: `/v3/users/8675810435b44e30a828c5c1cf8ae446` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:09.926610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc988-8416-4d9d-b217-16f7cfaacf3b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:09.929091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8675810435b44e30a828c5c1cf8ae446)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:09.931973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:09.936800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d2ecc988-8416-4d9d-b217-16f7cfaacf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:09.988223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc988-8416-4d9d-b217-16f7cfaacf3b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:10.003422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:10.004603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:10.005326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:10.007465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] PATH_INFO: `/v3/projects/74eafc75882a43758d444e584b14c90c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:10.012176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74eafc75882a43758d444e584b14c90c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:10.014807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:10.043467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:10.081536 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8675810435b44e30a828c5c1cf8ae446'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.084681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8675810435b44e30a828c5c1cf8ae446'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.117862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8675810435b44e30a828c5c1cf8ae446'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.139922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8675810435b44e30a828c5c1cf8ae446'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.156991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-87a19cd4-1eac-46e6-adeb-9fd2e3084dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8675810435b44e30a828c5c1cf8ae446'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.165837 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74eafc75882a43758d444e584b14c90c', 'request_id': 'req-4f969043-f377-4950-9a05-72c08f04f5e7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.175789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 880/1754] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:09 2022] DELETE /identity/v3/users/8675810435b44e30a828c5c1cf8ae446 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:10.176627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a676d-f322-4ce0-9c77-e8deef64a9c6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:10.177157 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a676d-f322-4ce0-9c77-e8deef64a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:10.177447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a676d-f322-4ce0-9c77-e8deef64a9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:10.180678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74eafc75882a43758d444e584b14c90c', 'request_id': 'req-4f969043-f377-4950-9a05-72c08f04f5e7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.202298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74eafc75882a43758d444e584b14c90c', 'request_id': 'req-4f969043-f377-4950-9a05-72c08f04f5e7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.242247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] The token cache is being invalidate because project 74eafc75882a43758d444e584b14c90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:10.242605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.243607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f969043-f377-4950-9a05-72c08f04f5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:10.252762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 875/1755] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:09 2022] DELETE /identity/v3/projects/74eafc75882a43758d444e584b14c90c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:10.258690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87560c-6f6e-41c3-aad9-35eca038f173 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:10.259046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87560c-6f6e-41c3-aad9-35eca038f173 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:10.259405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87560c-6f6e-41c3-aad9-35eca038f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:10.274885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-670a676d-f322-4ce0-9c77-e8deef64a9c6 None None] MFA Rules not processed for user `1f5f828f41aa47cc8adbf84ae6d82e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:10.278728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-670a676d-f322-4ce0-9c77-e8deef64a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:10.339830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9c87560c-6f6e-41c3-aad9-35eca038f173 None None] MFA Rules not processed for user `f447a34300944a5da25f6408f802f602`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:10.347577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9c87560c-6f6e-41c3-aad9-35eca038f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:10.443299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:10.553644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 881/1756] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:10.564519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a676d-f322-4ce0-9c77-e8deef64a9c6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:10.576246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-670a676d-f322-4ce0-9c77-e8deef64a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:10.610769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 876/1757] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:10.624295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6c717-8bab-4f57-8ab8-2131f3c2dcec None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:10.624295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6c717-8bab-4f57-8ab8-2131f3c2dcec None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:10.624295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6c717-8bab-4f57-8ab8-2131f3c2dcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:10.700461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b8d6c717-8bab-4f57-8ab8-2131f3c2dcec None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:10.703743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b8d6c717-8bab-4f57-8ab8-2131f3c2dcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:10.914823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a676d-f322-4ce0-9c77-e8deef64a9c6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:10.928902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:10.931485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:10.932135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:10.933099 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:10.941759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:10.984294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 877/1758] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:10.988165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd15e0-2e97-41e1-839e-e91ed47e3677 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:10.990835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd15e0-2e97-41e1-839e-e91ed47e3677 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:10.993025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd15e0-2e97-41e1-839e-e91ed47e3677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:10.997451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:11.005543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:11.042954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 882/1759] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:11.058212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-04dd15e0-2e97-41e1-839e-e91ed47e3677 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:11.064706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-04dd15e0-2e97-41e1-839e-e91ed47e3677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:11.083490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:11.085408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:11.107291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f201-2cbd-44fb-97c5-58e6c6f7cb9a service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:11.109966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 878/1760] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:11.120676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5904e96-ffbb-4d4a-a848-0bcda2349356 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:11.121114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5904e96-ffbb-4d4a-a848-0bcda2349356 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:11.121495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5904e96-ffbb-4d4a-a848-0bcda2349356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:11.133214 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245334-19f5-4c9d-bd31-1107835b2e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:11.133964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245334-19f5-4c9d-bd31-1107835b2e2d service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:11.134245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245334-19f5-4c9d-bd31-1107835b2e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:11.134516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245334-19f5-4c9d-bd31-1107835b2e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:11.170945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245334-19f5-4c9d-bd31-1107835b2e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:11.172806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245334-19f5-4c9d-bd31-1107835b2e2d service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:11.190460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c5904e96-ffbb-4d4a-a848-0bcda2349356 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:11.195901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c5904e96-ffbb-4d4a-a848-0bcda2349356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:11.207040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 883/1761] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:11.223550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 879/1762] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:11.227733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245334-19f5-4c9d-bd31-1107835b2e2d service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:11.245355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245334-19f5-4c9d-bd31-1107835b2e2d service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:11.262958 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e04fac-e132-436a-a593-7add48b5e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:11.263609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e04fac-e132-436a-a593-7add48b5e2ab admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:11.263949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e04fac-e132-436a-a593-7add48b5e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:11.264249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e04fac-e132-436a-a593-7add48b5e2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:11.264941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e04fac-e132-436a-a593-7add48b5e2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:11.265276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e04fac-e132-436a-a593-7add48b5e2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:11.267212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e04fac-e132-436a-a593-7add48b5e2ab admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:11.328675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 884/1763] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:33:11.340541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5904e96-ffbb-4d4a-a848-0bcda2349356 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:11.369539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5904e96-ffbb-4d4a-a848-0bcda2349356 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:11.388337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218cd2-ea1b-48d3-bdd1-768878b6b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:11.389400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218cd2-ea1b-48d3-bdd1-768878b6b419 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:11.392332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218cd2-ea1b-48d3-bdd1-768878b6b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:11.393001 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218cd2-ea1b-48d3-bdd1-768878b6b419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:11.394522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6218cd2-ea1b-48d3-bdd1-768878b6b419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:11.401705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6218cd2-ea1b-48d3-bdd1-768878b6b419 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:11.508764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 880/1764] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:11 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:11.516473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e04fac-e132-436a-a593-7add48b5e2ab admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:11.558365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e04fac-e132-436a-a593-7add48b5e2ab admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:11.943195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22e852-204b-416a-9c24-a745a25643f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:11.943927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22e852-204b-416a-9c24-a745a25643f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:11.944454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22e852-204b-416a-9c24-a745a25643f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:11.944975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22e852-204b-416a-9c24-a745a25643f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:11.946244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22e852-204b-416a-9c24-a745a25643f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:11.955738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22e852-204b-416a-9c24-a745a25643f8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:12.090363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218cd2-ea1b-48d3-bdd1-768878b6b419 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:12.100060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 885/1765] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:11 2022] POST /identity/v3/users => generated 295 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:12.122304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:12.140814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218cd2-ea1b-48d3-bdd1-768878b6b419 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:12.165223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1767-9429-4949-9dfc-e8192250ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:12.166341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1767-9429-4949-9dfc-e8192250ddab admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:12.166892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1767-9429-4949-9dfc-e8192250ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:12.167397 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1767-9429-4949-9dfc-e8192250ddab admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:12.168684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f1767-9429-4949-9dfc-e8192250ddab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:12.172037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f1767-9429-4949-9dfc-e8192250ddab admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:12.229143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22e852-204b-416a-9c24-a745a25643f8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:12.235721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 881/1766] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:12.269944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22e852-204b-416a-9c24-a745a25643f8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:12.301261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6a1e4-aa1b-4713-893d-67dbace997ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:12.305922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6a1e4-aa1b-4713-893d-67dbace997ae admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:12.308063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6a1e4-aa1b-4713-893d-67dbace997ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:12.309318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6a1e4-aa1b-4713-893d-67dbace997ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:12.314739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6a1e4-aa1b-4713-893d-67dbace997ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:12.319191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6a1e4-aa1b-4713-893d-67dbace997ae admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:12.387783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1767-9429-4949-9dfc-e8192250ddab admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:12.400305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 886/1767] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:33:12.415821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1767-9429-4949-9dfc-e8192250ddab admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:12.448721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4881144-9bd4-4b8f-b93c-a0ef24de2fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:12.450270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881144-9bd4-4b8f-b93c-a0ef24de2fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:12.450806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881144-9bd4-4b8f-b93c-a0ef24de2fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:12.451343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881144-9bd4-4b8f-b93c-a0ef24de2fe2 admin admin] PATH_INFO: `/v3/projects/e3bab375e3844b22bd26c01d0e24179a/users/0b22dfd52821495caf4fa6e0a434efcf/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:12.519998 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4881144-9bd4-4b8f-b93c-a0ef24de2fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bab375e3844b22bd26c01d0e24179a, user_id=0b22dfd52821495caf4fa6e0a434efcf, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:12.526421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4881144-9bd4-4b8f-b93c-a0ef24de2fe2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:12.602435 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 882/1768] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:12 2022] PUT /identity/v3/projects/e3bab375e3844b22bd26c01d0e24179a/users/0b22dfd52821495caf4fa6e0a434efcf/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:12.632425 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05e309-c874-4dbd-a49c-660a884a036d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:12.637715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05e309-c874-4dbd-a49c-660a884a036d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:12.638404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05e309-c874-4dbd-a49c-660a884a036d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:12.716893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5d05e309-c874-4dbd-a49c-660a884a036d None None] MFA Rules not processed for user `0b22dfd52821495caf4fa6e0a434efcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:12.719883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5d05e309-c874-4dbd-a49c-660a884a036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:12.779894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:12.911073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 887/1769] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:12.916574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4881144-9bd4-4b8f-b93c-a0ef24de2fe2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:13.223506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4881144-9bd4-4b8f-b93c-a0ef24de2fe2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:13.236073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baeb99-b390-4619-9b26-a7b172deae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:13.236732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baeb99-b390-4619-9b26-a7b172deae81 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:13.237299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baeb99-b390-4619-9b26-a7b172deae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:13.237870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baeb99-b390-4619-9b26-a7b172deae81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:13.238794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baeb99-b390-4619-9b26-a7b172deae81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:13.242512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baeb99-b390-4619-9b26-a7b172deae81 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:13.338303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 883/1770] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:12 2022] POST /identity/v3/projects => generated 389 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:13.343178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05e309-c874-4dbd-a49c-660a884a036d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:13.360847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05e309-c874-4dbd-a49c-660a884a036d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:13.598109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4983b-eea2-434e-b24f-8cedff6b721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:13.599449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4983b-eea2-434e-b24f-8cedff6b721d admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:13.599847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4983b-eea2-434e-b24f-8cedff6b721d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:13.600151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4983b-eea2-434e-b24f-8cedff6b721d admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:13.600915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4983b-eea2-434e-b24f-8cedff6b721d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:13.608982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4983b-eea2-434e-b24f-8cedff6b721d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:13.673240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 888/1771] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:13 2022] POST /identity/v3/users => generated 301 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:13.676730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baeb99-b390-4619-9b26-a7b172deae81 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:13.705804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baeb99-b390-4619-9b26-a7b172deae81 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:13.729933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48907030-7e84-4b7a-acc7-ca38e33d95ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:13.731649 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48907030-7e84-4b7a-acc7-ca38e33d95ac admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:13.732236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48907030-7e84-4b7a-acc7-ca38e33d95ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:13.733057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48907030-7e84-4b7a-acc7-ca38e33d95ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:13.734073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48907030-7e84-4b7a-acc7-ca38e33d95ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:13.736488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48907030-7e84-4b7a-acc7-ca38e33d95ac admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:13.757060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 884/1772] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:13.761406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4983b-eea2-434e-b24f-8cedff6b721d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:13.787359 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4983b-eea2-434e-b24f-8cedff6b721d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:13.805783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b0dd3-31af-40e7-bd63-a08929d4c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:13.808390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b0dd3-31af-40e7-bd63-a08929d4c882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:13.809924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b0dd3-31af-40e7-bd63-a08929d4c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:13.811135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b0dd3-31af-40e7-bd63-a08929d4c882 admin admin] PATH_INFO: `/v3/projects/46e7f158b74e4018b0264ab9fc29efbf/users/9d0a151d8136404f8d4fcfbd6844061a/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:13.861830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839732da-6042-41e8-bdac-dfe672b9b44b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:13.862125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839732da-6042-41e8-bdac-dfe672b9b44b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:13.862411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839732da-6042-41e8-bdac-dfe672b9b44b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:13.864152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 885/1773] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:33:13.884036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40bfbf-ede2-44c7-b29f-d6d5dd257805 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:13.884619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40bfbf-ede2-44c7-b29f-d6d5dd257805 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:13.885046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40bfbf-ede2-44c7-b29f-d6d5dd257805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:13.897312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b0dd3-31af-40e7-bd63-a08929d4c882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e7f158b74e4018b0264ab9fc29efbf, user_id=9d0a151d8136404f8d4fcfbd6844061a, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:13.904527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b0dd3-31af-40e7-bd63-a08929d4c882 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:13.928233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bf40bfbf-ede2-44c7-b29f-d6d5dd257805 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:13.930106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bf40bfbf-ede2-44c7-b29f-d6d5dd257805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:13.951498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 889/1774] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:13 2022] PUT /identity/v3/projects/46e7f158b74e4018b0264ab9fc29efbf/users/9d0a151d8136404f8d4fcfbd6844061a/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:13.956549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b0dd3-31af-40e7-bd63-a08929d4c882 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:14.130199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b0dd3-31af-40e7-bd63-a08929d4c882 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:14.138193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ded01-04d8-4681-b787-6b3654c42eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:14.138862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ded01-04d8-4681-b787-6b3654c42eae admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:14.139206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ded01-04d8-4681-b787-6b3654c42eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:14.139544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ded01-04d8-4681-b787-6b3654c42eae admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:14.140496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ded01-04d8-4681-b787-6b3654c42eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:14.142168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ded01-04d8-4681-b787-6b3654c42eae admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:14.195813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 890/1775] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:33:14.200860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ded01-04d8-4681-b787-6b3654c42eae admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:14.230640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ded01-04d8-4681-b787-6b3654c42eae admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:14.243688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8a731-1eb4-4693-96cb-decb930a4136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:14.244598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a731-1eb4-4693-96cb-decb930a4136 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:14.245172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a731-1eb4-4693-96cb-decb930a4136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:14.245618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a731-1eb4-4693-96cb-decb930a4136 admin admin] PATH_INFO: `/v3/projects/46e7f158b74e4018b0264ab9fc29efbf/users/9d0a151d8136404f8d4fcfbd6844061a/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:14.251899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8a731-1eb4-4693-96cb-decb930a4136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e7f158b74e4018b0264ab9fc29efbf, user_id=9d0a151d8136404f8d4fcfbd6844061a, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:14.255530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8a731-1eb4-4693-96cb-decb930a4136 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:14.259920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 886/1776] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:33:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:14.270061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 891/1777] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:14 2022] PUT /identity/v3/projects/46e7f158b74e4018b0264ab9fc29efbf/users/9d0a151d8136404f8d4fcfbd6844061a/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:14.282606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858e79a-f4de-4d20-b494-629525ec6ec8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:14.283264 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858e79a-f4de-4d20-b494-629525ec6ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:14.284815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858e79a-f4de-4d20-b494-629525ec6ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:14.404387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8a731-1eb4-4693-96cb-decb930a4136 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:14.406640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-83b8a731-1eb4-4693-96cb-decb930a4136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:14.425351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:14.447484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a858e79a-f4de-4d20-b494-629525ec6ec8 None None] MFA Rules not processed for user `9d0a151d8136404f8d4fcfbd6844061a`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:14.457597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a858e79a-f4de-4d20-b494-629525ec6ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:14.524618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:14.567026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8a731-1eb4-4693-96cb-decb930a4136 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:14.579821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:14.580508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:14.580780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:14.581238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] PATH_INFO: `/v3/users/b9c5a1a7334648ebb140ffdc6d3e72ff` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:14.583435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c5a1a7334648ebb140ffdc6d3e72ff)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:14.590562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:14.719260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c5a1a7334648ebb140ffdc6d3e72ff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:14.721177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c5a1a7334648ebb140ffdc6d3e72ff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:14.745994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 887/1778] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:14.757334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c5a1a7334648ebb140ffdc6d3e72ff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:14.767170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858e79a-f4de-4d20-b494-629525ec6ec8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:14.769098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a858e79a-f4de-4d20-b494-629525ec6ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:14.783251 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c5a1a7334648ebb140ffdc6d3e72ff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:14.800501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a79b113-f918-4e84-8155-672550146c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c5a1a7334648ebb140ffdc6d3e72ff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:14.824173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 892/1779] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:14 2022] DELETE /identity/v3/users/b9c5a1a7334648ebb140ffdc6d3e72ff => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:14.829000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c1c7e-34f7-4cc3-87c9-00349dd05ab7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:14.829552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c1c7e-34f7-4cc3-87c9-00349dd05ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:14.830486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c1c7e-34f7-4cc3-87c9-00349dd05ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:14.889720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f50c1c7e-34f7-4cc3-87c9-00349dd05ab7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:14.891631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f50c1c7e-34f7-4cc3-87c9-00349dd05ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:14.935587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858e79a-f4de-4d20-b494-629525ec6ec8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:15.017699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 893/1780] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:15.035538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c1c7e-34f7-4cc3-87c9-00349dd05ab7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:15.038782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f50c1c7e-34f7-4cc3-87c9-00349dd05ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:15.088253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b58d6-8252-4fa7-8bbf-231ecc01b693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:15.089276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b58d6-8252-4fa7-8bbf-231ecc01b693 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:15.089747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b58d6-8252-4fa7-8bbf-231ecc01b693 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:15.099540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b58d6-8252-4fa7-8bbf-231ecc01b693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:15.108059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:15.125471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cf1b58d6-8252-4fa7-8bbf-231ecc01b693 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:15.182048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c1c7e-34f7-4cc3-87c9-00349dd05ab7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:15.205927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72610f12-7dd5-4f41-82ae-2d4fc206081d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:15.208676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72610f12-7dd5-4f41-82ae-2d4fc206081d service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:15.211568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72610f12-7dd5-4f41-82ae-2d4fc206081d service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:15.212278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72610f12-7dd5-4f41-82ae-2d4fc206081d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:15.271951 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72610f12-7dd5-4f41-82ae-2d4fc206081d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:15.284463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72610f12-7dd5-4f41-82ae-2d4fc206081d service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:15.334869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 894/1781] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:15.337397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f31e01-1bf9-456e-9a8c-ce39568cff16 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:15.337870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f31e01-1bf9-456e-9a8c-ce39568cff16 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:15.338318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f31e01-1bf9-456e-9a8c-ce39568cff16 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:15.346369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 895/1782] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:33:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:33:15.411670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b58d6-8252-4fa7-8bbf-231ecc01b693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:15.417940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b58d6-8252-4fa7-8bbf-231ecc01b693 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:15.433961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 888/1783] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:14 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:15.463954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f229-5793-4036-a93b-19a36a024260 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:15.464675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f229-5793-4036-a93b-19a36a024260 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:15.465182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f229-5793-4036-a93b-19a36a024260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:15.503190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128dfac-a626-4694-b0e9-f8b6ccfe543a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:15.507334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128dfac-a626-4694-b0e9-f8b6ccfe543a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:15.512872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128dfac-a626-4694-b0e9-f8b6ccfe543a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:15.516791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 889/1784] 10.222.0.78 () {54 vars in 912 bytes} [Wed Aug 24 03:33:15 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:33:15.524474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e9215-1c14-4cbc-8545-cb45472eec85 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:15.527304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e9215-1c14-4cbc-8545-cb45472eec85 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:15.527966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e9215-1c14-4cbc-8545-cb45472eec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:15.594895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-dd27f229-5793-4036-a93b-19a36a024260 None None] MFA Rules not processed for user `496b8b8fa8ad4cc59b7f3d2c48cdd977`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:15.598056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dd27f229-5793-4036-a93b-19a36a024260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:15.601695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-da6e9215-1c14-4cbc-8545-cb45472eec85 None None] MFA Rules not processed for user `0e7bc56706f2491b92f5745a0fbc2acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:15.617145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-da6e9215-1c14-4cbc-8545-cb45472eec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:15.627243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 890/1785] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:33:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:15.751521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e9215-1c14-4cbc-8545-cb45472eec85 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:15.753404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-da6e9215-1c14-4cbc-8545-cb45472eec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:15.780901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e9215-1c14-4cbc-8545-cb45472eec85 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:15.792808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace5ea-4982-4ed4-adb5-071117be1846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:15.800565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace5ea-4982-4ed4-adb5-071117be1846 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:15.801859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace5ea-4982-4ed4-adb5-071117be1846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:15.802422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace5ea-4982-4ed4-adb5-071117be1846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:15.838547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ace5ea-4982-4ed4-adb5-071117be1846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:15.844656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ace5ea-4982-4ed4-adb5-071117be1846 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:15.890363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 896/1786] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:33:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:15.929538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 891/1787] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:15.933058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27f229-5793-4036-a93b-19a36a024260 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:15.935352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dd27f229-5793-4036-a93b-19a36a024260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:15.974051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27f229-5793-4036-a93b-19a36a024260 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:15.991459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:15.993880 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:15.994161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:15.994469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] PATH_INFO: `/v3/users/0b22dfd52821495caf4fa6e0a434efcf` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:15.998716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b22dfd52821495caf4fa6e0a434efcf)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:16.008124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:16.127262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace5ea-4982-4ed4-adb5-071117be1846 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:16.129761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-94ace5ea-4982-4ed4-adb5-071117be1846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:16.201973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b22dfd52821495caf4fa6e0a434efcf'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:16.203362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b22dfd52821495caf4fa6e0a434efcf'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:16.226220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace5ea-4982-4ed4-adb5-071117be1846 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:16.226475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b22dfd52821495caf4fa6e0a434efcf'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:16.241719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b22dfd52821495caf4fa6e0a434efcf'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:16.260122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ccf03c52-3e0c-4639-a063-719ccf9f5fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b22dfd52821495caf4fa6e0a434efcf'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:16.274174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:16.281099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:16.288740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 897/1788] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:15 2022] DELETE /identity/v3/users/0b22dfd52821495caf4fa6e0a434efcf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:16.296001 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:16.296425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:16.299519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d5765-5291-4e99-8f94-0d7040414aa3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:16.301946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d5765-5291-4e99-8f94-0d7040414aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:16.302953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d5765-5291-4e99-8f94-0d7040414aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:16.304672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:16.331923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:16.352355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:16.354123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:16.392071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-731d5765-5291-4e99-8f94-0d7040414aa3 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:16.398091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-731d5765-5291-4e99-8f94-0d7040414aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:16.415685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 892/1789] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:16.505654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:16.538897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:16.543451 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:16.653757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 898/1790] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:16.711597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d5765-5291-4e99-8f94-0d7040414aa3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:16.713420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-731d5765-5291-4e99-8f94-0d7040414aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:16.861142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d5765-5291-4e99-8f94-0d7040414aa3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:16.866848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830ea4-c499-44f2-9a50-a2dce2eb0c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:16.870522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830ea4-c499-44f2-9a50-a2dce2eb0c5b service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:16.870866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830ea4-c499-44f2-9a50-a2dce2eb0c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:16.871183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830ea4-c499-44f2-9a50-a2dce2eb0c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:16.895444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830ea4-c499-44f2-9a50-a2dce2eb0c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:16.897452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830ea4-c499-44f2-9a50-a2dce2eb0c5b service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:16.915821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 899/1791] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:16.945993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954050d2-9bbb-4aad-80b8-6747dc8f9422 service placement] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:17.267758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830ea4-c499-44f2-9a50-a2dce2eb0c5b service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:17.269716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2c830ea4-c499-44f2-9a50-a2dce2eb0c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:17.301677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830ea4-c499-44f2-9a50-a2dce2eb0c5b service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:17.347342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:17.349775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d772ac3-164f-49f9-9af0-3040493876e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:17.350606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d772ac3-164f-49f9-9af0-3040493876e0 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:17.350947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d772ac3-164f-49f9-9af0-3040493876e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:17.351224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d772ac3-164f-49f9-9af0-3040493876e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:17.353643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:17.354332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:17.357643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] PATH_INFO: `/v3/projects/e922bbef02874c8887f97d1805592347` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:17.367724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1d772ac3-164f-49f9-9af0-3040493876e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:17.371321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e922bbef02874c8887f97d1805592347)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:17.390550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:17.421974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d772ac3-164f-49f9-9af0-3040493876e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:17.425137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d772ac3-164f-49f9-9af0-3040493876e0 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:17.460791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 893/1792] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 923 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:17.642927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e922bbef02874c8887f97d1805592347', 'request_id': 'req-6e8024e2-a003-4e58-89cf-4a64a2980de3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:17.683107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e922bbef02874c8887f97d1805592347', 'request_id': 'req-6e8024e2-a003-4e58-89cf-4a64a2980de3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:17.739650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e922bbef02874c8887f97d1805592347', 'request_id': 'req-6e8024e2-a003-4e58-89cf-4a64a2980de3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:17.842031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] The token cache is being invalidate because project e922bbef02874c8887f97d1805592347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:17.842438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:17.852505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:17.863150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 900/1793] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:17 2022] DELETE /identity/v3/projects/e922bbef02874c8887f97d1805592347 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:17.866484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d772ac3-164f-49f9-9af0-3040493876e0 service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:17.889872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d772ac3-164f-49f9-9af0-3040493876e0 service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:18.093474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:18.094568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:18.095129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:18.095590 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] PATH_INFO: `/v3/users/f0fa1a46cd97466abfbdf43da55de995` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:18.097538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0fa1a46cd97466abfbdf43da55de995)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:18.100638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:18.174956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:18.270206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0fa1a46cd97466abfbdf43da55de995'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:18.272720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0fa1a46cd97466abfbdf43da55de995'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:18.277254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0fa1a46cd97466abfbdf43da55de995'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:18.341559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0fa1a46cd97466abfbdf43da55de995'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:18.367032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0fa1a46cd97466abfbdf43da55de995'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:18.482710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 894/1794] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:17 2022] DELETE /identity/v3/users/f0fa1a46cd97466abfbdf43da55de995 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:18.856023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:18.857823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:18.917697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8024e2-a003-4e58-89cf-4a64a2980de3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:19.182211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:19.183487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:19.184078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:19.188489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] PATH_INFO: `/v3/projects/d888fad119be48b8a24adf137770970e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:19.191641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d888fad119be48b8a24adf137770970e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:19.196188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:19.213332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:19.404000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd888fad119be48b8a24adf137770970e', 'request_id': 'req-37feee41-d3ac-41d2-a193-4ed71eb078b0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.427357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd888fad119be48b8a24adf137770970e', 'request_id': 'req-37feee41-d3ac-41d2-a193-4ed71eb078b0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.451627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd888fad119be48b8a24adf137770970e', 'request_id': 'req-37feee41-d3ac-41d2-a193-4ed71eb078b0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.475689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] The token cache is being invalidate because project d888fad119be48b8a24adf137770970e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:19.476262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.479220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37feee41-d3ac-41d2-a193-4ed71eb078b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.481311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 901/1795] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:18 2022] DELETE /identity/v3/projects/d888fad119be48b8a24adf137770970e => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:19.486677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:19.490065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:19.549689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dbc3e-12d4-4d45-8ea0-49655debb0e8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:19.681584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:19.682894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:19.683340 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:19.683764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] PATH_INFO: `/v3/users/1bf5c19c88094e36a6e072672d4019b8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:19.686277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf5c19c88094e36a6e072672d4019b8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:19.689759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:19.779762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf5c19c88094e36a6e072672d4019b8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.780879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf5c19c88094e36a6e072672d4019b8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.783016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf5c19c88094e36a6e072672d4019b8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.814945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf5c19c88094e36a6e072672d4019b8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.846129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-720bb6c9-9900-44d3-a135-cf68982bdfc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf5c19c88094e36a6e072672d4019b8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:19.883498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 895/1796] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:19 2022] DELETE /identity/v3/users/1bf5c19c88094e36a6e072672d4019b8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:20.361601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32130e-1312-43e6-9079-d743bb0ca214 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:20.362222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32130e-1312-43e6-9079-d743bb0ca214 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:20.362222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32130e-1312-43e6-9079-d743bb0ca214 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:20.364983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 902/1797] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:33:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:33:20.419698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7181a-d35f-4e0f-8e42-3a10824a4f66 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:20.419934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7181a-d35f-4e0f-8e42-3a10824a4f66 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:20.420615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7181a-d35f-4e0f-8e42-3a10824a4f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:20.462091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-73f7181a-d35f-4e0f-8e42-3a10824a4f66 None None] MFA Rules not processed for user `496b8b8fa8ad4cc59b7f3d2c48cdd977`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:20.463662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-73f7181a-d35f-4e0f-8e42-3a10824a4f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:20.488945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:20.517338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32130e-1312-43e6-9079-d743bb0ca214 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:20.522349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ab32130e-1312-43e6-9079-d743bb0ca214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:20.635074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 896/1798] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:33:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:20.742316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7181a-d35f-4e0f-8e42-3a10824a4f66 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:20.744855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-73f7181a-d35f-4e0f-8e42-3a10824a4f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:20.800781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7181a-d35f-4e0f-8e42-3a10824a4f66 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:20.816878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:20.818606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:20.818968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:20.819466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] PATH_INFO: `/v3/users/f85c35c69cf54b4eb53db629dac09aa6` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:20.822776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32130e-1312-43e6-9079-d743bb0ca214 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:20.840391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85c35c69cf54b4eb53db629dac09aa6)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:20.840535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:20.842128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:20.842641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:20.843326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] PATH_INFO: `/v3/projects/e3bab375e3844b22bd26c01d0e24179a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:20.844444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:20.846331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bab375e3844b22bd26c01d0e24179a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:20.855736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:21.018001 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85c35c69cf54b4eb53db629dac09aa6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.019266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85c35c69cf54b4eb53db629dac09aa6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.020547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85c35c69cf54b4eb53db629dac09aa6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.048388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bab375e3844b22bd26c01d0e24179a', 'request_id': 'req-7d344bb4-dc2f-44c2-b538-1fdb351d5840'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.069640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85c35c69cf54b4eb53db629dac09aa6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.088866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bab375e3844b22bd26c01d0e24179a', 'request_id': 'req-7d344bb4-dc2f-44c2-b538-1fdb351d5840'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.130423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85c35c69cf54b4eb53db629dac09aa6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.135343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bab375e3844b22bd26c01d0e24179a', 'request_id': 'req-7d344bb4-dc2f-44c2-b538-1fdb351d5840'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.173603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 897/1799] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:20 2022] DELETE /identity/v3/users/f85c35c69cf54b4eb53db629dac09aa6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:21.175752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:21.181468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:21.203335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] The token cache is being invalidate because project e3bab375e3844b22bd26c01d0e24179a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:21.203808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.210751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.214378 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 903/1800] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:20 2022] DELETE /identity/v3/projects/e3bab375e3844b22bd26c01d0e24179a => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:21.228769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:21.233963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:21.403059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:21.482269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07791d-7bf3-4c61-837c-6b63f877dc25 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:21.507585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:21.514208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:21.514950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:21.515536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:21.522586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:21.556704 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d344bb4-dc2f-44c2-b538-1fdb351d5840 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:21.560505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:21.564519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:21.589957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 898/1801] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:21.716501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:21.717674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:21.718163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:21.718836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] PATH_INFO: `/v3/users/9d0a151d8136404f8d4fcfbd6844061a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:21.721102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0a151d8136404f8d4fcfbd6844061a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:21.724646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:21.804326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0a151d8136404f8d4fcfbd6844061a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.810160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:21.810779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0a151d8136404f8d4fcfbd6844061a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.813074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:21.841328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f34a6-9858-470b-b24a-fd63580abe9d service placement] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:21.843551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0a151d8136404f8d4fcfbd6844061a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.851486 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:21.852751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:21.853204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:21.853626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] PATH_INFO: `/v3/projects/5986b9446bb045158a79e402b3e8861b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:21.859902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5986b9446bb045158a79e402b3e8861b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:21.863975 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0a151d8136404f8d4fcfbd6844061a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.866613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:21.881527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b24a7da-edc9-4a11-a65a-1f3423b778a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0a151d8136404f8d4fcfbd6844061a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:21.898999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 904/1802] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:21 2022] DELETE /identity/v3/users/9d0a151d8136404f8d4fcfbd6844061a => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:21.900124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:22.015438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5986b9446bb045158a79e402b3e8861b', 'request_id': 'req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.027096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5986b9446bb045158a79e402b3e8861b', 'request_id': 'req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.038275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5986b9446bb045158a79e402b3e8861b', 'request_id': 'req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.061519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] The token cache is being invalidate because project 5986b9446bb045158a79e402b3e8861b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:22.062039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.063898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-97f1af0d-c9b1-46fd-be9b-cf89bafd15e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.067716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 899/1803] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:21 2022] DELETE /identity/v3/projects/5986b9446bb045158a79e402b3e8861b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:22.073576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9d49-6cec-4a49-b64b-c24c3dd53191 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:22.073864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9d49-6cec-4a49-b64b-c24c3dd53191 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:22.074141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9d49-6cec-4a49-b64b-c24c3dd53191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:22.102090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-544f9d49-6cec-4a49-b64b-c24c3dd53191 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:22.103712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-544f9d49-6cec-4a49-b64b-c24c3dd53191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:22.195800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:22.230582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 905/1804] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:22.241558 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30a03-a51c-447d-922f-9a186e94bbf1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:22.242178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30a03-a51c-447d-922f-9a186e94bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:22.242597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30a03-a51c-447d-922f-9a186e94bbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:22.266944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bcd30a03-a51c-447d-922f-9a186e94bbf1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:22.268371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bcd30a03-a51c-447d-922f-9a186e94bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:22.281590 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 900/1805] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:22.283444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9d49-6cec-4a49-b64b-c24c3dd53191 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:22.295820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9d49-6cec-4a49-b64b-c24c3dd53191 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:22.302492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddcc64-657a-467a-b46d-bddc9f965f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:22.303511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddcc64-657a-467a-b46d-bddc9f965f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:22.303818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddcc64-657a-467a-b46d-bddc9f965f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:22.304226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddcc64-657a-467a-b46d-bddc9f965f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:22.305574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddcc64-657a-467a-b46d-bddc9f965f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:22.305900 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddcc64-657a-467a-b46d-bddc9f965f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:22.307573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddcc64-657a-467a-b46d-bddc9f965f0e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:22.321995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 906/1806] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:22.328053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30a03-a51c-447d-922f-9a186e94bbf1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:22.351604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30a03-a51c-447d-922f-9a186e94bbf1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:22.359063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655c06-8249-4b07-9518-a3a332776479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:22.359811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655c06-8249-4b07-9518-a3a332776479 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:22.360146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655c06-8249-4b07-9518-a3a332776479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:22.360480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655c06-8249-4b07-9518-a3a332776479 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:22.361203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655c06-8249-4b07-9518-a3a332776479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:22.363431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655c06-8249-4b07-9518-a3a332776479 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:22.400743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 901/1807] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:22 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:22.405373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddcc64-657a-467a-b46d-bddc9f965f0e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:22.417758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddcc64-657a-467a-b46d-bddc9f965f0e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:22.430124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655c06-8249-4b07-9518-a3a332776479 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:22.432210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cd655c06-8249-4b07-9518-a3a332776479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:22.543148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8d8df-f997-46e2-859c-e646d8dae369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:22.543935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8d8df-f997-46e2-859c-e646d8dae369 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:22.544316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8d8df-f997-46e2-859c-e646d8dae369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:22.544728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8d8df-f997-46e2-859c-e646d8dae369 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:22.545485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8d8df-f997-46e2-859c-e646d8dae369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:22.548017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8d8df-f997-46e2-859c-e646d8dae369 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:22.579182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 907/1808] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:22 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:22.580791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8d8df-f997-46e2-859c-e646d8dae369 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:22.583367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-08d8d8df-f997-46e2-859c-e646d8dae369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:22.591903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655c06-8249-4b07-9518-a3a332776479 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:22.600907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:22.602088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:22.602593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:22.603171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] PATH_INFO: `/v3/projects/4634505bfff74f40a34bd82c6cd674e7` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:22.609172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4634505bfff74f40a34bd82c6cd674e7)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:22.609463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8d8df-f997-46e2-859c-e646d8dae369 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:22.611454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:22.616276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:22.617163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:22.617163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:22.617588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] PATH_INFO: `/v3/projects/e0b3b6a1079c403a9b6e77a5f46e428b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:22.621677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b3b6a1079c403a9b6e77a5f46e428b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:22.623740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:22.692723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b3b6a1079c403a9b6e77a5f46e428b', 'request_id': 'req-b1451189-0d16-4122-bdd8-644f011048b1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.711398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b3b6a1079c403a9b6e77a5f46e428b', 'request_id': 'req-b1451189-0d16-4122-bdd8-644f011048b1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.752504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b3b6a1079c403a9b6e77a5f46e428b', 'request_id': 'req-b1451189-0d16-4122-bdd8-644f011048b1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.753375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4634505bfff74f40a34bd82c6cd674e7', 'request_id': 'req-389e223e-6785-4c44-a86d-081a76c1fc3e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.772103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4634505bfff74f40a34bd82c6cd674e7', 'request_id': 'req-389e223e-6785-4c44-a86d-081a76c1fc3e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.779295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] The token cache is being invalidate because project e0b3b6a1079c403a9b6e77a5f46e428b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:22.779657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.780378 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.790117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 908/1809] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:22 2022] DELETE /identity/v3/projects/e0b3b6a1079c403a9b6e77a5f46e428b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:22.791750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4634505bfff74f40a34bd82c6cd674e7', 'request_id': 'req-389e223e-6785-4c44-a86d-081a76c1fc3e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.792036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:22.794684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:22.809336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:22.821958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] The token cache is being invalidate because project 4634505bfff74f40a34bd82c6cd674e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:22.823262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.824373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-389e223e-6785-4c44-a86d-081a76c1fc3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:22.831013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 902/1810] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:22 2022] DELETE /identity/v3/projects/4634505bfff74f40a34bd82c6cd674e7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:22.832559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ea111-d979-405e-9778-11a97e5ff921 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:22.832900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ea111-d979-405e-9778-11a97e5ff921 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:22.833429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ea111-d979-405e-9778-11a97e5ff921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:22.859159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0d3ea111-d979-405e-9778-11a97e5ff921 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:22.860450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0d3ea111-d979-405e-9778-11a97e5ff921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:22.912260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:22.940182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1451189-0d16-4122-bdd8-644f011048b1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:22.989401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 903/1811] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:23.001465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ea111-d979-405e-9778-11a97e5ff921 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:23.003225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0d3ea111-d979-405e-9778-11a97e5ff921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:23.040029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ea111-d979-405e-9778-11a97e5ff921 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:23.045886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:23.046560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.047023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.047352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] PATH_INFO: `/v3/users/1f5f828f41aa47cc8adbf84ae6d82e2a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.049924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5f828f41aa47cc8adbf84ae6d82e2a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:23.052586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:23.055322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82877b4e-e94b-4618-baa9-d8e7701675a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:23.056239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82877b4e-e94b-4618-baa9-d8e7701675a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.056408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82877b4e-e94b-4618-baa9-d8e7701675a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.056604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82877b4e-e94b-4618-baa9-d8e7701675a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.057242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82877b4e-e94b-4618-baa9-d8e7701675a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:23.059184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82877b4e-e94b-4618-baa9-d8e7701675a3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:23.078238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 909/1812] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:23.078238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c7e7-9731-4773-9e85-d7464a68149a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.078238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c7e7-9731-4773-9e85-d7464a68149a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.078238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c7e7-9731-4773-9e85-d7464a68149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.097279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-87d0c7e7-9731-4773-9e85-d7464a68149a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:23.099189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-87d0c7e7-9731-4773-9e85-d7464a68149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:23.115617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 910/1813] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:23.115617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c7e7-9731-4773-9e85-d7464a68149a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:23.118285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-87d0c7e7-9731-4773-9e85-d7464a68149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:23.144402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c7e7-9731-4773-9e85-d7464a68149a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:23.155814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318272da-790c-45f8-8429-0b5d6d282cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:23.157825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318272da-790c-45f8-8429-0b5d6d282cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.158262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318272da-790c-45f8-8429-0b5d6d282cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.158784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318272da-790c-45f8-8429-0b5d6d282cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.160161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318272da-790c-45f8-8429-0b5d6d282cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:23.169112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318272da-790c-45f8-8429-0b5d6d282cc4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:23.204705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 911/1814] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:23.204705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318272da-790c-45f8-8429-0b5d6d282cc4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:23.205369 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5f828f41aa47cc8adbf84ae6d82e2a'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.206215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5f828f41aa47cc8adbf84ae6d82e2a'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.207040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5f828f41aa47cc8adbf84ae6d82e2a'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.224211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318272da-790c-45f8-8429-0b5d6d282cc4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:23.230237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:23.230909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.231186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.231468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.232134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:23.232440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:23.236138 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:23.260714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5f828f41aa47cc8adbf84ae6d82e2a'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.270244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 912/1815] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:23.271272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:23.276283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:23.280552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5f828f41aa47cc8adbf84ae6d82e2a'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.298517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdb9e2-dc83-4606-beaf-d442cdcb1959 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:23.304894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:23.305698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.305979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.306324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] PATH_INFO: `/v3/projects/46e7f158b74e4018b0264ab9fc29efbf` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.308069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e7f158b74e4018b0264ab9fc29efbf)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:23.310698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:23.311557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 904/1816] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:22 2022] DELETE /identity/v3/users/1f5f828f41aa47cc8adbf84ae6d82e2a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:23.313202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:23.324376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:23.433807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e7f158b74e4018b0264ab9fc29efbf', 'request_id': 'req-0b8e3b5d-0581-4c90-8155-fb4930a9d484'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.455144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e7f158b74e4018b0264ab9fc29efbf', 'request_id': 'req-0b8e3b5d-0581-4c90-8155-fb4930a9d484'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.468162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e7f158b74e4018b0264ab9fc29efbf', 'request_id': 'req-0b8e3b5d-0581-4c90-8155-fb4930a9d484'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.488113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] The token cache is being invalidate because project 46e7f158b74e4018b0264ab9fc29efbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:23.488669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.495451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:23.498731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 913/1817] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:23 2022] DELETE /identity/v3/projects/46e7f158b74e4018b0264ab9fc29efbf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:23.507486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:23.510053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:23.581119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:23.589568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f50c96-ca90-4b66-ab30-79f2f693ad13 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:23.608644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e3b5d-0581-4c90-8155-fb4930a9d484 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:23.623557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507881-1ddc-4d22-97bd-46955cb9801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:23.626812 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7305d-08c9-400a-b8d7-06d981bdd7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:23.627411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507881-1ddc-4d22-97bd-46955cb9801a admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.627879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507881-1ddc-4d22-97bd-46955cb9801a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.628346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507881-1ddc-4d22-97bd-46955cb9801a admin admin] PATH_INFO: `/v3/projects/f7d8387ac4f64d26b035ca07a134b6b8/users/831640d01fed44d78f87fff04235b5d1/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.628651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7305d-08c9-400a-b8d7-06d981bdd7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.629117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7305d-08c9-400a-b8d7-06d981bdd7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.629587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7305d-08c9-400a-b8d7-06d981bdd7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.633435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7305d-08c9-400a-b8d7-06d981bdd7c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:23.636940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7305d-08c9-400a-b8d7-06d981bdd7c5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:23.672861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba507881-1ddc-4d22-97bd-46955cb9801a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d8387ac4f64d26b035ca07a134b6b8, user_id=831640d01fed44d78f87fff04235b5d1, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:23.677341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba507881-1ddc-4d22-97bd-46955cb9801a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:23.681438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:23.718845 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 914/1818] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:23 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:23.720388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb786d-9a82-4d76-9c35-4e12af3d7d89 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.720681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb786d-9a82-4d76-9c35-4e12af3d7d89 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.720957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb786d-9a82-4d76-9c35-4e12af3d7d89 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.722828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 915/1819] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:33:23.724312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98845f-efe1-4620-9bbc-6e43307cac37 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.724589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98845f-efe1-4620-9bbc-6e43307cac37 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.724859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98845f-efe1-4620-9bbc-6e43307cac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:23.734702 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 905/1820] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:23 2022] PUT /identity/v3/projects/f7d8387ac4f64d26b035ca07a134b6b8/users/831640d01fed44d78f87fff04235b5d1/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:23.738894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507881-1ddc-4d22-97bd-46955cb9801a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:23.761961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-eb98845f-efe1-4620-9bbc-6e43307cac37 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:23.765687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eb98845f-efe1-4620-9bbc-6e43307cac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:23.901961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507881-1ddc-4d22-97bd-46955cb9801a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:23.932181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 916/1821] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:23.933648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c8b26-b7a0-4b3a-b197-f8c44528a342 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:23.933938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c8b26-b7a0-4b3a-b197-f8c44528a342 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:23.934212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c8b26-b7a0-4b3a-b197-f8c44528a342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.050003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-029c8b26-b7a0-4b3a-b197-f8c44528a342 None None] MFA Rules not processed for user `831640d01fed44d78f87fff04235b5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:24.053105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-029c8b26-b7a0-4b3a-b197-f8c44528a342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.092910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3f604-eebe-4be9-bee2-f747467f8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.094462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3f604-eebe-4be9-bee2-f747467f8e8e admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.095732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3f604-eebe-4be9-bee2-f747467f8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.096282 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3f604-eebe-4be9-bee2-f747467f8e8e admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.097715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3f604-eebe-4be9-bee2-f747467f8e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.103229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3f604-eebe-4be9-bee2-f747467f8e8e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:24.154323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 906/1822] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:23 2022] POST /identity/v3/users => generated 297 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:24.158321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182f38-2a7e-4e2b-be21-8cba4e822421 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.158810 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182f38-2a7e-4e2b-be21-8cba4e822421 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.159281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182f38-2a7e-4e2b-be21-8cba4e822421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.202349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-82182f38-2a7e-4e2b-be21-8cba4e822421 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:24.204999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-82182f38-2a7e-4e2b-be21-8cba4e822421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.269308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 917/1823] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:24.269308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef654aa-56bc-4747-9bd3-3edd17fdb336 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.269308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef654aa-56bc-4747-9bd3-3edd17fdb336 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.289308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef654aa-56bc-4747-9bd3-3edd17fdb336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.352894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cef654aa-56bc-4747-9bd3-3edd17fdb336 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:24.354703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cef654aa-56bc-4747-9bd3-3edd17fdb336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.374964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 918/1824] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:24.376973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef654aa-56bc-4747-9bd3-3edd17fdb336 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.384658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cef654aa-56bc-4747-9bd3-3edd17fdb336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.385869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 907/1825] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:33:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:24.387084 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182f38-2a7e-4e2b-be21-8cba4e822421 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.399672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182f38-2a7e-4e2b-be21-8cba4e822421 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:24.413531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef654aa-56bc-4747-9bd3-3edd17fdb336 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:24.415569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2a0b6-94c2-4a8e-8fd8-6edad4a870eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.416380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2a0b6-94c2-4a8e-8fd8-6edad4a870eb admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.416663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2a0b6-94c2-4a8e-8fd8-6edad4a870eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.416937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2a0b6-94c2-4a8e-8fd8-6edad4a870eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.417624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2a0b6-94c2-4a8e-8fd8-6edad4a870eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.419354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2a0b6-94c2-4a8e-8fd8-6edad4a870eb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:24.423406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.424593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.425106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.426245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] PATH_INFO: `/v3/projects/4281ea781e624b5c904c36baa572c6a1` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.428826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4281ea781e624b5c904c36baa572c6a1)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.431594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:24.434509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 908/1826] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:24.435664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2a0b6-94c2-4a8e-8fd8-6edad4a870eb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.438007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1aa2a0b6-94c2-4a8e-8fd8-6edad4a870eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.453542 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2a0b6-94c2-4a8e-8fd8-6edad4a870eb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:24.464541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab562b-c21a-4375-bd07-777c02fbe5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.465835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab562b-c21a-4375-bd07-777c02fbe5dc admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.466450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab562b-c21a-4375-bd07-777c02fbe5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.467995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab562b-c21a-4375-bd07-777c02fbe5dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.472032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab562b-c21a-4375-bd07-777c02fbe5dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.480972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab562b-c21a-4375-bd07-777c02fbe5dc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:24.505876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:24.519078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4281ea781e624b5c904c36baa572c6a1', 'request_id': 'req-f2fe50cd-a601-4f89-a9e0-95b07d973b74'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:24.521215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:24.536447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4281ea781e624b5c904c36baa572c6a1', 'request_id': 'req-f2fe50cd-a601-4f89-a9e0-95b07d973b74'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:24.549750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4281ea781e624b5c904c36baa572c6a1', 'request_id': 'req-f2fe50cd-a601-4f89-a9e0-95b07d973b74'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:24.561656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 909/1827] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:24 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:24.564718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab562b-c21a-4375-bd07-777c02fbe5dc admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.581865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] The token cache is being invalidate because project 4281ea781e624b5c904c36baa572c6a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:24.581865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:24.581865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:24.581865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 919/1828] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:24 2022] DELETE /identity/v3/projects/4281ea781e624b5c904c36baa572c6a1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:24.581865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.582874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.670959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab562b-c21a-4375-bd07-777c02fbe5dc admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:24.677350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.678253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.678560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.678886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.679562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:24.679868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.681537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:24.698365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 910/1829] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:24.698671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.700642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.708284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe50cd-a601-4f89-a9e0-95b07d973b74 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:24.715491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e68a2-fcfe-4f72-b094-004edd2b3678 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:24.722099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb9394-5adb-438e-af4c-a90a108cff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.722785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb9394-5adb-438e-af4c-a90a108cff74 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.723073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb9394-5adb-438e-af4c-a90a108cff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.723324 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb9394-5adb-438e-af4c-a90a108cff74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.724029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb9394-5adb-438e-af4c-a90a108cff74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.725787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb9394-5adb-438e-af4c-a90a108cff74 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:24.742380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 911/1830] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:24.744224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb9394-5adb-438e-af4c-a90a108cff74 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.753100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-58eb9394-5adb-438e-af4c-a90a108cff74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.788627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb9394-5adb-438e-af4c-a90a108cff74 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:24.797631 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3619b46-9031-4670-9557-aecc5510489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.799186 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3619b46-9031-4670-9557-aecc5510489d admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.799744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3619b46-9031-4670-9557-aecc5510489d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.800312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3619b46-9031-4670-9557-aecc5510489d admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.801790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3619b46-9031-4670-9557-aecc5510489d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.803527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae27dbe-ca18-476f-aabf-aa848665f587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.804237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae27dbe-ca18-476f-aabf-aa848665f587 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.804747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae27dbe-ca18-476f-aabf-aa848665f587 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.805100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae27dbe-ca18-476f-aabf-aa848665f587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.805901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3619b46-9031-4670-9557-aecc5510489d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:24.807854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eae27dbe-ca18-476f-aabf-aa848665f587 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.824655 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae27dbe-ca18-476f-aabf-aa848665f587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.828066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae27dbe-ca18-476f-aabf-aa848665f587 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:24.843955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 920/1831] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:24.846339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a462e6-6a8c-4332-974d-8b1ae84489b4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.846981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a462e6-6a8c-4332-974d-8b1ae84489b4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.847262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a462e6-6a8c-4332-974d-8b1ae84489b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.848723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 912/1832] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:24 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:24.850356 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3619b46-9031-4670-9557-aecc5510489d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.853437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e3619b46-9031-4670-9557-aecc5510489d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.873374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b6a462e6-6a8c-4332-974d-8b1ae84489b4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:24.874892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b6a462e6-6a8c-4332-974d-8b1ae84489b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:24.885905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3619b46-9031-4670-9557-aecc5510489d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:24.890861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 921/1833] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:24.892736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a462e6-6a8c-4332-974d-8b1ae84489b4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.904673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07624d13-883e-436d-9acc-afc560d4101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.906086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07624d13-883e-436d-9acc-afc560d4101f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.906909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07624d13-883e-436d-9acc-afc560d4101f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.908055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07624d13-883e-436d-9acc-afc560d4101f admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.909912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07624d13-883e-436d-9acc-afc560d4101f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.913351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07624d13-883e-436d-9acc-afc560d4101f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:24.917589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a462e6-6a8c-4332-974d-8b1ae84489b4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:24.927904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f48763-8d92-4bac-a7cb-d3e58ecd851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:24.928803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f48763-8d92-4bac-a7cb-d3e58ecd851a admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:24.929089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f48763-8d92-4bac-a7cb-d3e58ecd851a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:24.929365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f48763-8d92-4bac-a7cb-d3e58ecd851a admin admin] PATH_INFO: `/v3/projects/89c03ec164f54299a4f043655261f53d/users/6f543bf4838a4bb6b9b636aac7084582/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:24.973781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 913/1834] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:24 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:24.974900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07624d13-883e-436d-9acc-afc560d4101f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:24.983959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f48763-8d92-4bac-a7cb-d3e58ecd851a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c03ec164f54299a4f043655261f53d, user_id=6f543bf4838a4bb6b9b636aac7084582, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:24.986468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f48763-8d92-4bac-a7cb-d3e58ecd851a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.017994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 922/1835] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:24 2022] PUT /identity/v3/projects/89c03ec164f54299a4f043655261f53d/users/6f543bf4838a4bb6b9b636aac7084582/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:25.029657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50e46-d225-4f07-b067-e9b54565ffb6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.029657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50e46-d225-4f07-b067-e9b54565ffb6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.029657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50e46-d225-4f07-b067-e9b54565ffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.059253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6ba50e46-d225-4f07-b067-e9b54565ffb6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:25.060988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6ba50e46-d225-4f07-b067-e9b54565ffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:25.086814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07624d13-883e-436d-9acc-afc560d4101f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.138185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:25.154585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:25.192206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa397d6-7db7-4d5b-bb2d-fcad801d6de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.193452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa397d6-7db7-4d5b-bb2d-fcad801d6de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.193593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa397d6-7db7-4d5b-bb2d-fcad801d6de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.194312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa397d6-7db7-4d5b-bb2d-fcad801d6de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.195724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa397d6-7db7-4d5b-bb2d-fcad801d6de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.199429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa397d6-7db7-4d5b-bb2d-fcad801d6de7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.207685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 923/1836] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:25.209387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50e46-d225-4f07-b067-e9b54565ffb6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.221527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 914/1837] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:25.223585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6d104-5dae-44ef-ab37-6404782ece9a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.224113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6d104-5dae-44ef-ab37-6404782ece9a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.224249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50e46-d225-4f07-b067-e9b54565ffb6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.224902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6d104-5dae-44ef-ab37-6404782ece9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.232447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faaefd-82cc-4168-b6b6-f45e73580947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.233478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faaefd-82cc-4168-b6b6-f45e73580947 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.233866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faaefd-82cc-4168-b6b6-f45e73580947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.235329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faaefd-82cc-4168-b6b6-f45e73580947 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.235937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faaefd-82cc-4168-b6b6-f45e73580947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.238601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faaefd-82cc-4168-b6b6-f45e73580947 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.262065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2cc6d104-5dae-44ef-ab37-6404782ece9a None None] MFA Rules not processed for user `6f543bf4838a4bb6b9b636aac7084582`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:25.263358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2cc6d104-5dae-44ef-ab37-6404782ece9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:25.267650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 924/1838] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:25 2022] POST /identity/v3/users => generated 287 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:25.268680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faaefd-82cc-4168-b6b6-f45e73580947 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.281187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faaefd-82cc-4168-b6b6-f45e73580947 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.287349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd4bbf-ab9f-46f5-ad46-a8dada89cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.288001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd4bbf-ab9f-46f5-ad46-a8dada89cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.288325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd4bbf-ab9f-46f5-ad46-a8dada89cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.288631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd4bbf-ab9f-46f5-ad46-a8dada89cb29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.289349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd4bbf-ab9f-46f5-ad46-a8dada89cb29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:25.289648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd4bbf-ab9f-46f5-ad46-a8dada89cb29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.291530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd4bbf-ab9f-46f5-ad46-a8dada89cb29 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.306144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 925/1839] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:25.307048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd4bbf-ab9f-46f5-ad46-a8dada89cb29 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.321757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd4bbf-ab9f-46f5-ad46-a8dada89cb29 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.328584 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4016f6-52d8-47b0-8bde-842141e0ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.329616 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4016f6-52d8-47b0-8bde-842141e0ebd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.329885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4016f6-52d8-47b0-8bde-842141e0ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.330155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4016f6-52d8-47b0-8bde-842141e0ebd3 admin admin] PATH_INFO: `/v3/projects/6bc57cc02c5145c882d823f722ff52cc/users/33d5c2c46e30462e8c5bb529d5943744/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.353184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4016f6-52d8-47b0-8bde-842141e0ebd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc57cc02c5145c882d823f722ff52cc, user_id=33d5c2c46e30462e8c5bb529d5943744, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.355800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4016f6-52d8-47b0-8bde-842141e0ebd3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.372794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 926/1840] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:25 2022] PUT /identity/v3/projects/6bc57cc02c5145c882d823f722ff52cc/users/33d5c2c46e30462e8c5bb529d5943744/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:25.376370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4016f6-52d8-47b0-8bde-842141e0ebd3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.384968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 915/1841] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:25.387691 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6d104-5dae-44ef-ab37-6404782ece9a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.416270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6d104-5dae-44ef-ab37-6404782ece9a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.523594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4016f6-52d8-47b0-8bde-842141e0ebd3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.530265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f9ec7-aae3-4d91-a276-35c5c3ddeab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.531050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f9ec7-aae3-4d91-a276-35c5c3ddeab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.531330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f9ec7-aae3-4d91-a276-35c5c3ddeab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.531673 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f9ec7-aae3-4d91-a276-35c5c3ddeab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.532510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f9ec7-aae3-4d91-a276-35c5c3ddeab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.534595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f9ec7-aae3-4d91-a276-35c5c3ddeab6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.564092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 927/1842] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:25.564092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f9ec7-aae3-4d91-a276-35c5c3ddeab6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.576792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40084629-6958-4ef0-ac15-c5fb08e35e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.577090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f9ec7-aae3-4d91-a276-35c5c3ddeab6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.577627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40084629-6958-4ef0-ac15-c5fb08e35e05 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.578003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40084629-6958-4ef0-ac15-c5fb08e35e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.578372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40084629-6958-4ef0-ac15-c5fb08e35e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.579476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40084629-6958-4ef0-ac15-c5fb08e35e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.581848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40084629-6958-4ef0-ac15-c5fb08e35e05 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.582373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c78c-73ea-453d-b262-b7be3efb1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.583428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c78c-73ea-453d-b262-b7be3efb1fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.583769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c78c-73ea-453d-b262-b7be3efb1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.583958 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c78c-73ea-453d-b262-b7be3efb1fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.584628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68c78c-73ea-453d-b262-b7be3efb1fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.586257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68c78c-73ea-453d-b262-b7be3efb1fc0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.602923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 928/1843] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:25.607694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c78c-73ea-453d-b262-b7be3efb1fc0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.630533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 916/1844] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:25 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:25.631783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40084629-6958-4ef0-ac15-c5fb08e35e05 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.632531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c78c-73ea-453d-b262-b7be3efb1fc0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.745930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3177-a502-4fec-af83-9a40e6b5eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.747073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3177-a502-4fec-af83-9a40e6b5eaaa admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.747563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3177-a502-4fec-af83-9a40e6b5eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.747721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:25.748387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3177-a502-4fec-af83-9a40e6b5eaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.749293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3177-a502-4fec-af83-9a40e6b5eaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.753320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3177-a502-4fec-af83-9a40e6b5eaaa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.763498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:25.768639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40084629-6958-4ef0-ac15-c5fb08e35e05 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.777867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a2f2-b238-4ad3-9490-dfaab97d7d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.778635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a2f2-b238-4ad3-9490-dfaab97d7d55 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.779194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a2f2-b238-4ad3-9490-dfaab97d7d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.779490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a2f2-b238-4ad3-9490-dfaab97d7d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.780220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a2f2-b238-4ad3-9490-dfaab97d7d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.781964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a2f2-b238-4ad3-9490-dfaab97d7d55 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.799556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 917/1845] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:25.801085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a2f2-b238-4ad3-9490-dfaab97d7d55 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.814731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 929/1846] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:25 2022] POST /identity/v3/projects => generated 393 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:25.816140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3177-a502-4fec-af83-9a40e6b5eaaa admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.818612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a2f2-b238-4ad3-9490-dfaab97d7d55 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:25.901973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e80676-5312-42ee-9464-5c17992f0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:25.902877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e80676-5312-42ee-9464-5c17992f0487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:25.903157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e80676-5312-42ee-9464-5c17992f0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:25.903440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e80676-5312-42ee-9464-5c17992f0487 admin admin] PATH_INFO: `/v3/projects/6bc57cc02c5145c882d823f722ff52cc/users/33d5c2c46e30462e8c5bb529d5943744/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:25.905698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e80676-5312-42ee-9464-5c17992f0487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc57cc02c5145c882d823f722ff52cc, user_id=33d5c2c46e30462e8c5bb529d5943744, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:25.908673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e80676-5312-42ee-9464-5c17992f0487 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:25.922196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 918/1847] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:25 2022] PUT /identity/v3/projects/6bc57cc02c5145c882d823f722ff52cc/users/33d5c2c46e30462e8c5bb529d5943744/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:25.923455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e80676-5312-42ee-9464-5c17992f0487 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:25.940362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3177-a502-4fec-af83-9a40e6b5eaaa admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.018192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e80676-5312-42ee-9464-5c17992f0487 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.025807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f296b02-69f8-4a26-8541-ac322d1390c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.026503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f296b02-69f8-4a26-8541-ac322d1390c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.026821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f296b02-69f8-4a26-8541-ac322d1390c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.027095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f296b02-69f8-4a26-8541-ac322d1390c8 admin admin] PATH_INFO: `/v3/projects/0ed06e5d479b4fae8889256152ef2f4b/users/9181e22abb624331bdff9035fb12c0e3/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.033217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c9666-dc95-4a04-94e2-54c0cf98c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.033949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c9666-dc95-4a04-94e2-54c0cf98c332 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.034247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c9666-dc95-4a04-94e2-54c0cf98c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.034538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c9666-dc95-4a04-94e2-54c0cf98c332 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.035256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c9666-dc95-4a04-94e2-54c0cf98c332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.037369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c9666-dc95-4a04-94e2-54c0cf98c332 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:26.044410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f296b02-69f8-4a26-8541-ac322d1390c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed06e5d479b4fae8889256152ef2f4b, user_id=9181e22abb624331bdff9035fb12c0e3, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.047618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f296b02-69f8-4a26-8541-ac322d1390c8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:26.063464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 930/1848] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:25 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:26.064522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c9666-dc95-4a04-94e2-54c0cf98c332 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:26.065638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 919/1849] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:25 2022] PUT /identity/v3/projects/0ed06e5d479b4fae8889256152ef2f4b/users/9181e22abb624331bdff9035fb12c0e3/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:26.067377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1e73a-62b6-4338-969d-4bc35afacf41 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.067668 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1e73a-62b6-4338-969d-4bc35afacf41 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.068038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1e73a-62b6-4338-969d-4bc35afacf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.079640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c9666-dc95-4a04-94e2-54c0cf98c332 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.116296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1ab1e73a-62b6-4338-969d-4bc35afacf41 None None] MFA Rules not processed for user `33d5c2c46e30462e8c5bb529d5943744`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:26.118227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1ab1e73a-62b6-4338-969d-4bc35afacf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:26.182257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ed05a-353d-4cdc-904d-a78d5022ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.183403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ed05a-353d-4cdc-904d-a78d5022ccc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.183883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ed05a-353d-4cdc-904d-a78d5022ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.184322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ed05a-353d-4cdc-904d-a78d5022ccc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.185346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ed05a-353d-4cdc-904d-a78d5022ccc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.188027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ed05a-353d-4cdc-904d-a78d5022ccc7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:26.204210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:26.220810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 931/1850] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:26 2022] POST /identity/v3/users => generated 303 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:26.221920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ed05a-353d-4cdc-904d-a78d5022ccc7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:26.238185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ed05a-353d-4cdc-904d-a78d5022ccc7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.243929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99f1f5-d0dc-4ecb-9ef2-10ce44ffb127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.245271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99f1f5-d0dc-4ecb-9ef2-10ce44ffb127 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.245271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99f1f5-d0dc-4ecb-9ef2-10ce44ffb127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.245691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99f1f5-d0dc-4ecb-9ef2-10ce44ffb127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.246448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99f1f5-d0dc-4ecb-9ef2-10ce44ffb127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.248921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99f1f5-d0dc-4ecb-9ef2-10ce44ffb127 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:26.263943 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 920/1851] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:26.268789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96bf6a-adcb-48ed-9d5e-26560112dfee None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.269263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96bf6a-adcb-48ed-9d5e-26560112dfee None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.269742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96bf6a-adcb-48ed-9d5e-26560112dfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.271360 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 932/1852] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:26.273059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99f1f5-d0dc-4ecb-9ef2-10ce44ffb127 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:26.289455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:26.307592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99f1f5-d0dc-4ecb-9ef2-10ce44ffb127 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.332261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-be96bf6a-adcb-48ed-9d5e-26560112dfee None None] MFA Rules not processed for user `9181e22abb624331bdff9035fb12c0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:26.334723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-be96bf6a-adcb-48ed-9d5e-26560112dfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:26.337182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007f2a0-5a3e-418a-9deb-99266a957e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.339430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007f2a0-5a3e-418a-9deb-99266a957e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.340284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007f2a0-5a3e-418a-9deb-99266a957e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.340739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007f2a0-5a3e-418a-9deb-99266a957e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.342295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007f2a0-5a3e-418a-9deb-99266a957e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.346604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007f2a0-5a3e-418a-9deb-99266a957e70 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:26.379662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 933/1853] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:26.379662 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007f2a0-5a3e-418a-9deb-99266a957e70 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:26.412630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007f2a0-5a3e-418a-9deb-99266a957e70 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.421727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ab59-6a66-472d-9723-72c6bb421f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.423039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ab59-6a66-472d-9723-72c6bb421f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.423349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ab59-6a66-472d-9723-72c6bb421f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.423756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ab59-6a66-472d-9723-72c6bb421f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.424576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6ab59-6a66-472d-9723-72c6bb421f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.428171 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6ab59-6a66-472d-9723-72c6bb421f26 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:26.450792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 934/1854] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:26.451711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ab59-6a66-472d-9723-72c6bb421f26 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:26.453678 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b1f6ab59-6a66-472d-9723-72c6bb421f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:26.508150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 921/1855] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:26.509001 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96bf6a-adcb-48ed-9d5e-26560112dfee None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:26.526143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ab59-6a66-472d-9723-72c6bb421f26 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.530102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512403-0cc9-4f95-be44-cf03346cbf3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.530863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512403-0cc9-4f95-be44-cf03346cbf3c service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.531212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512403-0cc9-4f95-be44-cf03346cbf3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.531562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512403-0cc9-4f95-be44-cf03346cbf3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.535644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96bf6a-adcb-48ed-9d5e-26560112dfee None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.543298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85512403-0cc9-4f95-be44-cf03346cbf3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.543787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc884c-5316-48b9-b04c-891cf5cfaf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.544953 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc884c-5316-48b9-b04c-891cf5cfaf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.545265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85512403-0cc9-4f95-be44-cf03346cbf3c service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:26.546190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc884c-5316-48b9-b04c-891cf5cfaf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.546794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc884c-5316-48b9-b04c-891cf5cfaf19 admin admin] PATH_INFO: `/v3/projects/969bb9e2207a4a03a1e4ebab76f217a4/users/1f73e6cbf9e8415eb95374c88473a508/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.558397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 935/1856] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:26.559497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512403-0cc9-4f95-be44-cf03346cbf3c service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:26.574576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512403-0cc9-4f95-be44-cf03346cbf3c service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.580374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d9110-7e42-4c11-9417-d0bf3211d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.581132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d9110-7e42-4c11-9417-d0bf3211d7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.581516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d9110-7e42-4c11-9417-d0bf3211d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.582005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d9110-7e42-4c11-9417-d0bf3211d7d9 admin admin] PATH_INFO: `/v3/projects/a4d262926a5548dc90ee44b7a735406f/users/8c0635fb01954732a63a1518accdae9e/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.607906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d9110-7e42-4c11-9417-d0bf3211d7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d262926a5548dc90ee44b7a735406f, user_id=8c0635fb01954732a63a1518accdae9e, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.611283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d9110-7e42-4c11-9417-d0bf3211d7d9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:26.635905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 936/1857] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:26 2022] PUT /identity/v3/projects/a4d262926a5548dc90ee44b7a735406f/users/8c0635fb01954732a63a1518accdae9e/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:26.637771 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc884c-5316-48b9-b04c-891cf5cfaf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969bb9e2207a4a03a1e4ebab76f217a4, user_id=1f73e6cbf9e8415eb95374c88473a508, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.640206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d9110-7e42-4c11-9417-d0bf3211d7d9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:26.641924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc884c-5316-48b9-b04c-891cf5cfaf19 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:26.647638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3d8d9110-7e42-4c11-9417-d0bf3211d7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:26.676907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 922/1858] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:26 2022] PUT /identity/v3/projects/969bb9e2207a4a03a1e4ebab76f217a4/users/1f73e6cbf9e8415eb95374c88473a508/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:26.683788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5194-0535-48ae-9073-47bda77448a7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.685276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5194-0535-48ae-9073-47bda77448a7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.685839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5194-0535-48ae-9073-47bda77448a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.757149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d9110-7e42-4c11-9417-d0bf3211d7d9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:26.819347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-433c5194-0535-48ae-9073-47bda77448a7 None None] MFA Rules not processed for user `8c0635fb01954732a63a1518accdae9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:26.821685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-433c5194-0535-48ae-9073-47bda77448a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:26.866304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b21b4-d2ef-4596-b195-ee4a054ea779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:26.867231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b21b4-d2ef-4596-b195-ee4a054ea779 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:26.867667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b21b4-d2ef-4596-b195-ee4a054ea779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:26.868030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b21b4-d2ef-4596-b195-ee4a054ea779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:26.945311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:26.994589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b21b4-d2ef-4596-b195-ee4a054ea779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:26.996394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b21b4-d2ef-4596-b195-ee4a054ea779 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:27.010131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 923/1859] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:27.012373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c5194-0535-48ae-9073-47bda77448a7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:27.016481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 937/1860] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:27.017557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b21b4-d2ef-4596-b195-ee4a054ea779 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:27.031558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b21b4-d2ef-4596-b195-ee4a054ea779 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:27.041315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51102592-1b1a-4ed2-80df-4a3f4af26398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:27.042459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51102592-1b1a-4ed2-80df-4a3f4af26398 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:27.043536 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51102592-1b1a-4ed2-80df-4a3f4af26398 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:27.044140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51102592-1b1a-4ed2-80df-4a3f4af26398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:27.057376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-51102592-1b1a-4ed2-80df-4a3f4af26398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:27.132910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:27.179309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c5194-0535-48ae-9073-47bda77448a7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:27.202830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca23f61-6c99-4860-a8fa-1b51a13cb33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:27.207359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23f61-6c99-4860-a8fa-1b51a13cb33f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:27.208784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23f61-6c99-4860-a8fa-1b51a13cb33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:27.209872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23f61-6c99-4860-a8fa-1b51a13cb33f admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:27.216401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca23f61-6c99-4860-a8fa-1b51a13cb33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:27.224518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca23f61-6c99-4860-a8fa-1b51a13cb33f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:27.249871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 924/1861] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:27.250770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca23f61-6c99-4860-a8fa-1b51a13cb33f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:27.256040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51102592-1b1a-4ed2-80df-4a3f4af26398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:27.259276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51102592-1b1a-4ed2-80df-4a3f4af26398 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:27.269015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca23f61-6c99-4860-a8fa-1b51a13cb33f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:27.278465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1da13-1402-435a-9c33-aa5e924bb40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:27.279547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1da13-1402-435a-9c33-aa5e924bb40b admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:27.280018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1da13-1402-435a-9c33-aa5e924bb40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:27.280476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1da13-1402-435a-9c33-aa5e924bb40b admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:27.281614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1da13-1402-435a-9c33-aa5e924bb40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:27.283407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 938/1862] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:27.286186 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1da13-1402-435a-9c33-aa5e924bb40b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:27.286442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51102592-1b1a-4ed2-80df-4a3f4af26398 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:27.314985 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51102592-1b1a-4ed2-80df-4a3f4af26398 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:27.326772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:27.329442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:27.330060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:27.330776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] PATH_INFO: `/v3/users/9181e22abb624331bdff9035fb12c0e3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:27.335712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9181e22abb624331bdff9035fb12c0e3)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:27.341401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:27.361300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 925/1863] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:27 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:27.364504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1da13-1402-435a-9c33-aa5e924bb40b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:27.489917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9181e22abb624331bdff9035fb12c0e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:27.495687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9181e22abb624331bdff9035fb12c0e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:27.536223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9181e22abb624331bdff9035fb12c0e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:27.563851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9181e22abb624331bdff9035fb12c0e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:27.607647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9181e22abb624331bdff9035fb12c0e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:27.637716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 939/1864] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:27 2022] DELETE /identity/v3/users/9181e22abb624331bdff9035fb12c0e3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:27.643307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:27.653208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1da13-1402-435a-9c33-aa5e924bb40b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:27.654875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:27.847837 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:27.865779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23d517-864e-4cdb-95ed-20b9f01a8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:27.867188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23d517-864e-4cdb-95ed-20b9f01a8c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:27.868915 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23d517-864e-4cdb-95ed-20b9f01a8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:27.869486 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23d517-864e-4cdb-95ed-20b9f01a8c92 admin admin] PATH_INFO: `/v3/projects/969bb9e2207a4a03a1e4ebab76f217a4/users/1f73e6cbf9e8415eb95374c88473a508/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:27.874511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23d517-864e-4cdb-95ed-20b9f01a8c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969bb9e2207a4a03a1e4ebab76f217a4, user_id=1f73e6cbf9e8415eb95374c88473a508, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:27.882609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23d517-864e-4cdb-95ed-20b9f01a8c92 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:27.912251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 926/1865] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:27 2022] PUT /identity/v3/projects/969bb9e2207a4a03a1e4ebab76f217a4/users/1f73e6cbf9e8415eb95374c88473a508/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:27.914407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f56e42-2523-40c8-b6d9-f31437fdefda None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:27.914848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f56e42-2523-40c8-b6d9-f31437fdefda None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:27.915357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f56e42-2523-40c8-b6d9-f31437fdefda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:27.925193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80f5ac-32bd-4eee-af7b-11dca55ccfec admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:27.958924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-64f56e42-2523-40c8-b6d9-f31437fdefda None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:27.961886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-64f56e42-2523-40c8-b6d9-f31437fdefda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:28.097245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:28.137694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 927/1866] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:28.141824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6542a8-1541-4c51-8157-fb80c250ef29 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:28.142525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6542a8-1541-4c51-8157-fb80c250ef29 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:28.143229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6542a8-1541-4c51-8157-fb80c250ef29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:28.273209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095004f-e392-4694-ad56-29c984cf5772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:28.274424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095004f-e392-4694-ad56-29c984cf5772 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:28.275051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095004f-e392-4694-ad56-29c984cf5772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:28.275616 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095004f-e392-4694-ad56-29c984cf5772 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:28.278599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095004f-e392-4694-ad56-29c984cf5772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:28.293446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1b6542a8-1541-4c51-8157-fb80c250ef29 None None] MFA Rules not processed for user `1f73e6cbf9e8415eb95374c88473a508`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:28.296202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1b6542a8-1541-4c51-8157-fb80c250ef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:28.313517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095004f-e392-4694-ad56-29c984cf5772 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:28.376557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 940/1867] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:27 2022] POST /identity/v3/users => generated 291 bytes in 734 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:28.378141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095004f-e392-4694-ad56-29c984cf5772 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:28.386046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d095004f-e392-4694-ad56-29c984cf5772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:28.499902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 928/1868] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:28.499902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6542a8-1541-4c51-8157-fb80c250ef29 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:28.531963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6542a8-1541-4c51-8157-fb80c250ef29 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:28.555343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c851380-47f0-453b-b880-4cfa98bc3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:28.555343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c851380-47f0-453b-b880-4cfa98bc3e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:28.555343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c851380-47f0-453b-b880-4cfa98bc3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:28.555878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c851380-47f0-453b-b880-4cfa98bc3e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:28.556998 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c851380-47f0-453b-b880-4cfa98bc3e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:28.559343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c851380-47f0-453b-b880-4cfa98bc3e12 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:28.570249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095004f-e392-4694-ad56-29c984cf5772 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:28.579303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 929/1869] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:28.580563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c851380-47f0-453b-b880-4cfa98bc3e12 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:28.585953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb566ba-47f0-4a38-8854-0684e2864f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:28.587164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb566ba-47f0-4a38-8854-0684e2864f2c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:28.587592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb566ba-47f0-4a38-8854-0684e2864f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:28.587964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb566ba-47f0-4a38-8854-0684e2864f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:28.588325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5c851380-47f0-453b-b880-4cfa98bc3e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:28.606123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb566ba-47f0-4a38-8854-0684e2864f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:28.608531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb566ba-47f0-4a38-8854-0684e2864f2c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:28.624508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 941/1870] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:28.626178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb566ba-47f0-4a38-8854-0684e2864f2c service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:28.642747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb566ba-47f0-4a38-8854-0684e2864f2c service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:28.649982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89289e-59f9-4fdd-9a80-5797a69e0571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:28.651182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89289e-59f9-4fdd-9a80-5797a69e0571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:28.652627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89289e-59f9-4fdd-9a80-5797a69e0571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:28.653181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89289e-59f9-4fdd-9a80-5797a69e0571 admin admin] PATH_INFO: `/v3/projects/24250839263945da93a56981327e7613/users/74083dc1e6fb4fcc85866867dc9fd4d3/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:28.697212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89289e-59f9-4fdd-9a80-5797a69e0571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24250839263945da93a56981327e7613, user_id=74083dc1e6fb4fcc85866867dc9fd4d3, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:28.704092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89289e-59f9-4fdd-9a80-5797a69e0571 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:28.732187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 942/1871] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:28 2022] PUT /identity/v3/projects/24250839263945da93a56981327e7613/users/74083dc1e6fb4fcc85866867dc9fd4d3/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:28.738032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89289e-59f9-4fdd-9a80-5797a69e0571 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:28.811423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c851380-47f0-453b-b880-4cfa98bc3e12 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:28.844609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:28.863071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89289e-59f9-4fdd-9a80-5797a69e0571 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:28.885342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5637743-015e-4bfe-9ef6-0bc19066821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:28.886432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637743-015e-4bfe-9ef6-0bc19066821d admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:28.887217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637743-015e-4bfe-9ef6-0bc19066821d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:28.887701 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637743-015e-4bfe-9ef6-0bc19066821d admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:28.888992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5637743-015e-4bfe-9ef6-0bc19066821d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:28.892433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5637743-015e-4bfe-9ef6-0bc19066821d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:28.922324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 943/1872] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:28.924005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5637743-015e-4bfe-9ef6-0bc19066821d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:28.949421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5637743-015e-4bfe-9ef6-0bc19066821d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:28.971519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8de175-8c5d-4d10-af12-b6cfdbca96be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:28.976757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8de175-8c5d-4d10-af12-b6cfdbca96be admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:28.978821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8de175-8c5d-4d10-af12-b6cfdbca96be admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:28.982468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8de175-8c5d-4d10-af12-b6cfdbca96be admin admin] PATH_INFO: `/v3/projects/24250839263945da93a56981327e7613/users/74083dc1e6fb4fcc85866867dc9fd4d3/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:28.985594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc39408-23a0-4a75-819d-48c53e5192ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:28.988200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc39408-23a0-4a75-819d-48c53e5192ae service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:28.989945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc39408-23a0-4a75-819d-48c53e5192ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:28.990645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8de175-8c5d-4d10-af12-b6cfdbca96be admin admin] RBAC: Authorizing `identity:create_grant(project_id=24250839263945da93a56981327e7613, user_id=74083dc1e6fb4fcc85866867dc9fd4d3, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:28.991527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc39408-23a0-4a75-819d-48c53e5192ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:29.004436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8de175-8c5d-4d10-af12-b6cfdbca96be admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:29.029862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 944/1873] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:28 2022] PUT /identity/v3/projects/24250839263945da93a56981327e7613/users/74083dc1e6fb4fcc85866867dc9fd4d3/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:29.046611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b5581-21a6-4f59-8e34-e7296949e1d5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:29.046969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b5581-21a6-4f59-8e34-e7296949e1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:29.047294 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b5581-21a6-4f59-8e34-e7296949e1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:29.143739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-622b5581-21a6-4f59-8e34-e7296949e1d5 None None] MFA Rules not processed for user `74083dc1e6fb4fcc85866867dc9fd4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:29.145039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-622b5581-21a6-4f59-8e34-e7296949e1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:29.159413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:29.193373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc39408-23a0-4a75-819d-48c53e5192ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:29.195918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc39408-23a0-4a75-819d-48c53e5192ae service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:29.213456 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 930/1874] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:29.263226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 945/1875] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:29.288496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc39408-23a0-4a75-819d-48c53e5192ae service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:29.290864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7dc39408-23a0-4a75-819d-48c53e5192ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:29.316420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc39408-23a0-4a75-819d-48c53e5192ae service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:29.384295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b5581-21a6-4f59-8e34-e7296949e1d5 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:29.386282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-622b5581-21a6-4f59-8e34-e7296949e1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:29.463733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd8b0-186e-4f07-b258-895334e58ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:29.464797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd8b0-186e-4f07-b258-895334e58ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:29.465296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd8b0-186e-4f07-b258-895334e58ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:29.465780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd8b0-186e-4f07-b258-895334e58ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:29.485058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdd8b0-186e-4f07-b258-895334e58ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:29.486565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdd8b0-186e-4f07-b258-895334e58ac9 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:29.520710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 931/1876] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:33:29.522993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd8b0-186e-4f07-b258-895334e58ac9 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:29.546579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd8b0-186e-4f07-b258-895334e58ac9 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:29.557861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9854bb-45f4-4bd5-ba2b-ab735c472131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:29.559072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9854bb-45f4-4bd5-ba2b-ab735c472131 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:29.559533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9854bb-45f4-4bd5-ba2b-ab735c472131 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:29.559869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9854bb-45f4-4bd5-ba2b-ab735c472131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:29.563335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4f9854bb-45f4-4bd5-ba2b-ab735c472131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:29.590891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b5581-21a6-4f59-8e34-e7296949e1d5 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:29.598103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:29.599532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:29.600183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:29.600826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] PATH_INFO: `/v3/projects/0ed06e5d479b4fae8889256152ef2f4b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:29.605015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed06e5d479b4fae8889256152ef2f4b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:29.610398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:29.721199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9854bb-45f4-4bd5-ba2b-ab735c472131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:29.722993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9854bb-45f4-4bd5-ba2b-ab735c472131 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:29.738584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 932/1877] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:29.799198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed06e5d479b4fae8889256152ef2f4b', 'request_id': 'req-f15ce836-373e-4641-8b36-84450a6eef1c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:29.801571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed06e5d479b4fae8889256152ef2f4b', 'request_id': 'req-f15ce836-373e-4641-8b36-84450a6eef1c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:29.803580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9854bb-45f4-4bd5-ba2b-ab735c472131 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:29.813800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed06e5d479b4fae8889256152ef2f4b', 'request_id': 'req-f15ce836-373e-4641-8b36-84450a6eef1c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:29.814132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9854bb-45f4-4bd5-ba2b-ab735c472131 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:29.821207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:29.836054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] The token cache is being invalidate because project 0ed06e5d479b4fae8889256152ef2f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:29.836881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:29.839660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f15ce836-373e-4641-8b36-84450a6eef1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:29.842213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 946/1878] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:29 2022] DELETE /identity/v3/projects/0ed06e5d479b4fae8889256152ef2f4b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:29.849532 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d9400-fe99-4dad-8710-530b76ed73af None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:29.850162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d9400-fe99-4dad-8710-530b76ed73af None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:29.850732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d9400-fe99-4dad-8710-530b76ed73af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:29.910127 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c66d9400-fe99-4dad-8710-530b76ed73af None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:29.912373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c66d9400-fe99-4dad-8710-530b76ed73af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:29.933716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e767d-6344-4c7b-a1b6-49e4ae7984ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:29.937009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e767d-6344-4c7b-a1b6-49e4ae7984ec service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:29.937719 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e767d-6344-4c7b-a1b6-49e4ae7984ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:29.941776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e767d-6344-4c7b-a1b6-49e4ae7984ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:29.945336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-484e767d-6344-4c7b-a1b6-49e4ae7984ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:30.003768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:30.030748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 947/1879] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:30.042997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e3312-6b89-4698-b300-1a659fecf91f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:30.043642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e3312-6b89-4698-b300-1a659fecf91f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:30.044077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e3312-6b89-4698-b300-1a659fecf91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:30.057752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e767d-6344-4c7b-a1b6-49e4ae7984ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:30.060396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e767d-6344-4c7b-a1b6-49e4ae7984ec service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:30.072176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-388e3312-6b89-4698-b300-1a659fecf91f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:30.073775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-388e3312-6b89-4698-b300-1a659fecf91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:30.080535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 933/1880] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:33:30.087772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 948/1881] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:30.096172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e767d-6344-4c7b-a1b6-49e4ae7984ec service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:30.122584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e767d-6344-4c7b-a1b6-49e4ae7984ec service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:30.147963 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f3e45-1933-491f-b7b5-57a68de19b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:30.151569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f3e45-1933-491f-b7b5-57a68de19b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:30.153511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f3e45-1933-491f-b7b5-57a68de19b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:30.154913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f3e45-1933-491f-b7b5-57a68de19b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:30.158184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f3e45-1933-491f-b7b5-57a68de19b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:30.158640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f3e45-1933-491f-b7b5-57a68de19b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:30.161671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f3e45-1933-491f-b7b5-57a68de19b3a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:30.195896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 934/1882] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:30.201148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e3312-6b89-4698-b300-1a659fecf91f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:30.222919 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e3312-6b89-4698-b300-1a659fecf91f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:30.248046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9221b1-040e-49c4-99a6-3a5d3c5cbd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:30.250813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9221b1-040e-49c4-99a6-3a5d3c5cbd2c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:30.251253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9221b1-040e-49c4-99a6-3a5d3c5cbd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:30.251699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9221b1-040e-49c4-99a6-3a5d3c5cbd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:30.252747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9221b1-040e-49c4-99a6-3a5d3c5cbd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:30.256391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9221b1-040e-49c4-99a6-3a5d3c5cbd2c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:30.326554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 949/1883] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:30 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:30.326799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f3e45-1933-491f-b7b5-57a68de19b3a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:30.361350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f3e45-1933-491f-b7b5-57a68de19b3a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:30.557253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bf07c-d092-4ce8-8a3f-a3d1e97f8457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:30.561466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf07c-d092-4ce8-8a3f-a3d1e97f8457 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:30.563665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf07c-d092-4ce8-8a3f-a3d1e97f8457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:30.563665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf07c-d092-4ce8-8a3f-a3d1e97f8457 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:30.571544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bf07c-d092-4ce8-8a3f-a3d1e97f8457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:30.580853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bf07c-d092-4ce8-8a3f-a3d1e97f8457 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:30.676896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 935/1884] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:30 2022] POST /identity/v3/users => generated 288 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:30.681751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9221b1-040e-49c4-99a6-3a5d3c5cbd2c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:30.700171 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9221b1-040e-49c4-99a6-3a5d3c5cbd2c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:30.707110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693537a-4661-42a7-8953-612eb4beaa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:30.707890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693537a-4661-42a7-8953-612eb4beaa30 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:30.708173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693537a-4661-42a7-8953-612eb4beaa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:30.708446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693537a-4661-42a7-8953-612eb4beaa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:30.709128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693537a-4661-42a7-8953-612eb4beaa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:30.716923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693537a-4661-42a7-8953-612eb4beaa30 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:30.747626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 950/1885] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:30.748544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bf07c-d092-4ce8-8a3f-a3d1e97f8457 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:30.785247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bf07c-d092-4ce8-8a3f-a3d1e97f8457 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:30.808487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5431d-93fa-4ab9-aa39-5cb24d836438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:30.809117 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5431d-93fa-4ab9-aa39-5cb24d836438 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:30.809401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5431d-93fa-4ab9-aa39-5cb24d836438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:30.809682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5431d-93fa-4ab9-aa39-5cb24d836438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:30.814577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5431d-93fa-4ab9-aa39-5cb24d836438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:30.816335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5431d-93fa-4ab9-aa39-5cb24d836438 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:30.865737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693537a-4661-42a7-8953-612eb4beaa30 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:30.867836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 936/1886] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:30.900690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693537a-4661-42a7-8953-612eb4beaa30 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:30.916901 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e155dc4-c00e-4967-8ac8-81482c68b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:30.917860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e155dc4-c00e-4967-8ac8-81482c68b7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:30.918137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e155dc4-c00e-4967-8ac8-81482c68b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:30.943670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e155dc4-c00e-4967-8ac8-81482c68b7b5 admin admin] PATH_INFO: `/v3/projects/698ae0258a0f4fa2b31325bc1083a1a3/users/030573ae35ba4ed2b0f8b94744ea09a7/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:31.024511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e155dc4-c00e-4967-8ac8-81482c68b7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698ae0258a0f4fa2b31325bc1083a1a3, user_id=030573ae35ba4ed2b0f8b94744ea09a7, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:31.027951 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e155dc4-c00e-4967-8ac8-81482c68b7b5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:31.058976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 951/1887] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:30 2022] PUT /identity/v3/projects/698ae0258a0f4fa2b31325bc1083a1a3/users/030573ae35ba4ed2b0f8b94744ea09a7/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:31.068158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67883-225c-4e83-b58c-3e7c684f1423 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:31.068748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67883-225c-4e83-b58c-3e7c684f1423 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:31.068748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67883-225c-4e83-b58c-3e7c684f1423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:31.118385 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-faa67883-225c-4e83-b58c-3e7c684f1423 None None] MFA Rules not processed for user `030573ae35ba4ed2b0f8b94744ea09a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:31.120351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-faa67883-225c-4e83-b58c-3e7c684f1423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:31.238298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802e3ad-e32e-45b2-8224-64d44ecff15b None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:31.238625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802e3ad-e32e-45b2-8224-64d44ecff15b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:31.239021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802e3ad-e32e-45b2-8224-64d44ecff15b None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:31.241198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 952/1888] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:33:31.260860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa215c-0b7c-4c3f-b6e2-3c5060626a21 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:31.261651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa215c-0b7c-4c3f-b6e2-3c5060626a21 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:31.263217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa215c-0b7c-4c3f-b6e2-3c5060626a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:31.324500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c5aa215c-0b7c-4c3f-b6e2-3c5060626a21 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:31.330220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c5aa215c-0b7c-4c3f-b6e2-3c5060626a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:31.340899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 937/1889] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:31.362079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67883-225c-4e83-b58c-3e7c684f1423 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:31.363703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-faa67883-225c-4e83-b58c-3e7c684f1423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:31.433302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:31.493406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67883-225c-4e83-b58c-3e7c684f1423 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:31.504946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59078084-5c2c-4291-9ea4-da8917914bd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c0b33c2c7947c59ebf8da17abbd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:31.505603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59078084-5c2c-4291-9ea4-da8917914bd1 service glance] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:31.505873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59078084-5c2c-4291-9ea4-da8917914bd1 service glance] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:31.506146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59078084-5c2c-4291-9ea4-da8917914bd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:31.514289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 953/1890] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:33:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:31.520980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59078084-5c2c-4291-9ea4-da8917914bd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:31.526156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59078084-5c2c-4291-9ea4-da8917914bd1 service glance] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:31.551236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 938/1891] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:33:32.193550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa215c-0b7c-4c3f-b6e2-3c5060626a21 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:32.195966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c5aa215c-0b7c-4c3f-b6e2-3c5060626a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:32.336186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:32.455395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59078084-5c2c-4291-9ea4-da8917914bd1 service glance] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:32.456531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-59078084-5c2c-4291-9ea4-da8917914bd1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:32.506040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa215c-0b7c-4c3f-b6e2-3c5060626a21 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:32.507089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59078084-5c2c-4291-9ea4-da8917914bd1 service glance] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:32.536234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51d3a-e085-48a6-8c29-b3ff51c022ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:32.538190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51d3a-e085-48a6-8c29-b3ff51c022ff service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:32.538190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51d3a-e085-48a6-8c29-b3ff51c022ff service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:32.538190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51d3a-e085-48a6-8c29-b3ff51c022ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:32.540076 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:32.541690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:32.543237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:32.544061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] PATH_INFO: `/v3/users/831640d01fed44d78f87fff04235b5d1` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:32.549730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831640d01fed44d78f87fff04235b5d1)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:32.566994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:32.581380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb51d3a-e085-48a6-8c29-b3ff51c022ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:32.581380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb51d3a-e085-48a6-8c29-b3ff51c022ff service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:32.621330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 939/1892] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:32.778056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831640d01fed44d78f87fff04235b5d1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:32.780021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831640d01fed44d78f87fff04235b5d1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:32.835891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831640d01fed44d78f87fff04235b5d1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:32.855778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831640d01fed44d78f87fff04235b5d1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:32.894282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831640d01fed44d78f87fff04235b5d1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:32.914170 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 954/1893] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:32 2022] DELETE /identity/v3/users/831640d01fed44d78f87fff04235b5d1 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:32.919614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beca10-0226-4d12-b826-6773bcf789fe None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:32.920271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beca10-0226-4d12-b826-6773bcf789fe None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:32.920843 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beca10-0226-4d12-b826-6773bcf789fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:32.954036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a2beca10-0226-4d12-b826-6773bcf789fe None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:32.969614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a2beca10-0226-4d12-b826-6773bcf789fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:33.214918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 940/1894] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:33.263057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:33.269015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:33.418582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82160b-644d-43af-b059-245560d677a1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:33.434835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c69ec-cab7-4fbf-a762-8d3d71b46265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:33.438718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c69ec-cab7-4fbf-a762-8d3d71b46265 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:33.438718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c69ec-cab7-4fbf-a762-8d3d71b46265 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:33.438718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c69ec-cab7-4fbf-a762-8d3d71b46265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:33.470216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c69ec-cab7-4fbf-a762-8d3d71b46265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:33.474869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c69ec-cab7-4fbf-a762-8d3d71b46265 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:33.538091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 955/1895] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:34.422423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beca10-0226-4d12-b826-6773bcf789fe None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:34.423949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a2beca10-0226-4d12-b826-6773bcf789fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:34.437063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beca10-0226-4d12-b826-6773bcf789fe None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:34.446386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:34.447077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:34.447375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:34.447821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] PATH_INFO: `/v3/projects/f7d8387ac4f64d26b035ca07a134b6b8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:34.449679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d8387ac4f64d26b035ca07a134b6b8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:34.453863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:34.526343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d8387ac4f64d26b035ca07a134b6b8', 'request_id': 'req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.538103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d8387ac4f64d26b035ca07a134b6b8', 'request_id': 'req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.546043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d8387ac4f64d26b035ca07a134b6b8', 'request_id': 'req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.565469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] The token cache is being invalidate because project f7d8387ac4f64d26b035ca07a134b6b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:34.565931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.566886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.570010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 941/1896] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:34 2022] DELETE /identity/v3/projects/f7d8387ac4f64d26b035ca07a134b6b8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:34.575178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c69ec-cab7-4fbf-a762-8d3d71b46265 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:34.604577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c69ec-cab7-4fbf-a762-8d3d71b46265 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:34.668672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:34.710152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:34.710930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:34.711742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:34.712399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] PATH_INFO: `/v3/users/33d5c2c46e30462e8c5bb529d5943744` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:34.714503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d5c2c46e30462e8c5bb529d5943744)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:34.719050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:34.846858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d5c2c46e30462e8c5bb529d5943744'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.849689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d5c2c46e30462e8c5bb529d5943744'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.884500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d5c2c46e30462e8c5bb529d5943744'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.931032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d5c2c46e30462e8c5bb529d5943744'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.958382 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d5c2c46e30462e8c5bb529d5943744'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:34.972268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 956/1897] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:34 2022] DELETE /identity/v3/users/33d5c2c46e30462e8c5bb529d5943744 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:35.920461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:35.922918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:35.947161 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc8b58-acdf-4ef8-9d40-4d2ccb94d886 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:36.009974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:36.084151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:36.093818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:36.250462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:36.251670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:36.252169 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:36.252666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] PATH_INFO: `/v3/users/6f543bf4838a4bb6b9b636aac7084582` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:36.266946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f543bf4838a4bb6b9b636aac7084582)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:36.278533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:36.482452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da745b18-71b4-4846-b2bc-cb427098c932 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:36.506720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f543bf4838a4bb6b9b636aac7084582'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.508971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f543bf4838a4bb6b9b636aac7084582'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.510221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f543bf4838a4bb6b9b636aac7084582'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.519540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:36.527890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:36.528168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:36.528540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] PATH_INFO: `/v3/projects/6bc57cc02c5145c882d823f722ff52cc` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:36.542700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc57cc02c5145c882d823f722ff52cc)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:36.549319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:36.561523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f543bf4838a4bb6b9b636aac7084582'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.588100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a4831e62-3695-464a-8dbb-185e41a1dd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f543bf4838a4bb6b9b636aac7084582'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.625401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 942/1898] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:35 2022] DELETE /identity/v3/users/6f543bf4838a4bb6b9b636aac7084582 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:36.632984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60473-8f8f-4797-9e9e-c90708da465f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:36.633311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60473-8f8f-4797-9e9e-c90708da465f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:36.633584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60473-8f8f-4797-9e9e-c90708da465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:36.687991 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-14d60473-8f8f-4797-9e9e-c90708da465f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:36.690215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-14d60473-8f8f-4797-9e9e-c90708da465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:36.738244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc57cc02c5145c882d823f722ff52cc', 'request_id': 'req-40b01576-d132-4155-8cf0-301c5342adb8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.758225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc57cc02c5145c882d823f722ff52cc', 'request_id': 'req-40b01576-d132-4155-8cf0-301c5342adb8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.784016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc57cc02c5145c882d823f722ff52cc', 'request_id': 'req-40b01576-d132-4155-8cf0-301c5342adb8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.799702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:36.829957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] The token cache is being invalidate because project 6bc57cc02c5145c882d823f722ff52cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:36.830536 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.832502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:36.836485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 957/1899] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:36 2022] DELETE /identity/v3/projects/6bc57cc02c5145c882d823f722ff52cc => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:36.839888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:36.844955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:36.901689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 943/1900] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:36.905920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c4980-1a72-4a9d-98eb-233163fca501 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:36.906447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c4980-1a72-4a9d-98eb-233163fca501 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:36.907012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c4980-1a72-4a9d-98eb-233163fca501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:36.977731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-965c4980-1a72-4a9d-98eb-233163fca501 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:36.980363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-965c4980-1a72-4a9d-98eb-233163fca501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:36.998550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 944/1901] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:36.999498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c4980-1a72-4a9d-98eb-233163fca501 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:37.004010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-965c4980-1a72-4a9d-98eb-233163fca501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:37.040942 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01576-d132-4155-8cf0-301c5342adb8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:37.050361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:37.051826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:37.052391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:37.052918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] PATH_INFO: `/v3/users/8c0635fb01954732a63a1518accdae9e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:37.055351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0635fb01954732a63a1518accdae9e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:37.058621 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:37.077513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:37.106489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c4980-1a72-4a9d-98eb-233163fca501 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:37.111431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67ad81-0044-43a2-b6fc-56d71c488197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:37.112124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67ad81-0044-43a2-b6fc-56d71c488197 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:37.112433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67ad81-0044-43a2-b6fc-56d71c488197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:37.112743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67ad81-0044-43a2-b6fc-56d71c488197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:37.126006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67ad81-0044-43a2-b6fc-56d71c488197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:37.127785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67ad81-0044-43a2-b6fc-56d71c488197 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:37.140498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 945/1902] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:37.142178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c311d5c-5bff-42a8-9b36-e57dd907fa02 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:37.146681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c311d5c-5bff-42a8-9b36-e57dd907fa02 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:37.146681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c311d5c-5bff-42a8-9b36-e57dd907fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:37.154776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0635fb01954732a63a1518accdae9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:37.155962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0635fb01954732a63a1518accdae9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:37.181331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7c311d5c-5bff-42a8-9b36-e57dd907fa02 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:37.183870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7c311d5c-5bff-42a8-9b36-e57dd907fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:37.196099 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0635fb01954732a63a1518accdae9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:37.210815 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0635fb01954732a63a1518accdae9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:37.217525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 946/1903] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:37.219546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c311d5c-5bff-42a8-9b36-e57dd907fa02 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:37.225483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e2e3ac3c-0758-40c5-8d21-0d3dd0c22ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0635fb01954732a63a1518accdae9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:37.243575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 958/1904] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:36 2022] DELETE /identity/v3/users/8c0635fb01954732a63a1518accdae9e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:37.246640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c311d5c-5bff-42a8-9b36-e57dd907fa02 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:37.255909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8705ac-3fe2-471b-af8f-2015fe4a7ebe None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:37.257013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8705ac-3fe2-471b-af8f-2015fe4a7ebe None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:37.257678 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8705ac-3fe2-471b-af8f-2015fe4a7ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:37.302988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6e8705ac-3fe2-471b-af8f-2015fe4a7ebe None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:37.311456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6e8705ac-3fe2-471b-af8f-2015fe4a7ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:37.497888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 959/1905] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:37.504432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af39c8-11ce-4291-bd69-26f149b6ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:37.504993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af39c8-11ce-4291-bd69-26f149b6ba0e admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:37.505418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af39c8-11ce-4291-bd69-26f149b6ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:37.506329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af39c8-11ce-4291-bd69-26f149b6ba0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:37.507739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af39c8-11ce-4291-bd69-26f149b6ba0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:37.511181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af39c8-11ce-4291-bd69-26f149b6ba0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:37.514737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af39c8-11ce-4291-bd69-26f149b6ba0e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:37.547313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8705ac-3fe2-471b-af8f-2015fe4a7ebe None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:37.550510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6e8705ac-3fe2-471b-af8f-2015fe4a7ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:37.554726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 947/1906] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:37.560459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af39c8-11ce-4291-bd69-26f149b6ba0e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:37.579856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af39c8-11ce-4291-bd69-26f149b6ba0e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:37.590576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e416-3e99-4845-89ae-0e5bf76c8384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:37.591705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e416-3e99-4845-89ae-0e5bf76c8384 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:37.592420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e416-3e99-4845-89ae-0e5bf76c8384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:37.600014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e416-3e99-4845-89ae-0e5bf76c8384 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:37.600014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4e416-3e99-4845-89ae-0e5bf76c8384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:37.603548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4e416-3e99-4845-89ae-0e5bf76c8384 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:37.607505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:37.665672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 948/1907] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:37 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:37.672605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e416-3e99-4845-89ae-0e5bf76c8384 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:37.798471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e416-3e99-4845-89ae-0e5bf76c8384 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:37.805415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29a6e-3d74-489e-ae54-a6d0c458f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:37.805981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8705ac-3fe2-471b-af8f-2015fe4a7ebe None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:37.806688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29a6e-3d74-489e-ae54-a6d0c458f221 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:37.806997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29a6e-3d74-489e-ae54-a6d0c458f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:37.807280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29a6e-3d74-489e-ae54-a6d0c458f221 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:37.808104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b29a6e-3d74-489e-ae54-a6d0c458f221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:37.810447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b29a6e-3d74-489e-ae54-a6d0c458f221 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:37.882769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 949/1908] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:37 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:37.885742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29a6e-3d74-489e-ae54-a6d0c458f221 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:37.914468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29a6e-3d74-489e-ae54-a6d0c458f221 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:37.923137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba80af-1d95-4221-8e2d-5bbd1fe61ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:37.924594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba80af-1d95-4221-8e2d-5bbd1fe61ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:37.926197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba80af-1d95-4221-8e2d-5bbd1fe61ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:37.927868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba80af-1d95-4221-8e2d-5bbd1fe61ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:37.929230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba80af-1d95-4221-8e2d-5bbd1fe61ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:37.936753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba80af-1d95-4221-8e2d-5bbd1fe61ab6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:37.976589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 950/1909] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:37.980608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df1f3b-b86e-4cb6-9233-91a77c620b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:37.981756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df1f3b-b86e-4cb6-9233-91a77c620b72 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:37.982237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df1f3b-b86e-4cb6-9233-91a77c620b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:37.982611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df1f3b-b86e-4cb6-9233-91a77c620b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:37.984904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba80af-1d95-4221-8e2d-5bbd1fe61ab6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:38.017990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df1f3b-b86e-4cb6-9233-91a77c620b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:38.020171 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df1f3b-b86e-4cb6-9233-91a77c620b72 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:38.027237 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba80af-1d95-4221-8e2d-5bbd1fe61ab6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:38.034841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4065473-1dcb-41a2-99d0-4fe437a67a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:38.035754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065473-1dcb-41a2-99d0-4fe437a67a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:38.036342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065473-1dcb-41a2-99d0-4fe437a67a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:38.036857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065473-1dcb-41a2-99d0-4fe437a67a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:38.041427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4065473-1dcb-41a2-99d0-4fe437a67a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:38.044211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4065473-1dcb-41a2-99d0-4fe437a67a4c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:38.056848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 960/1910] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:33:38.064915 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 951/1911] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:38.070758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df1f3b-b86e-4cb6-9233-91a77c620b72 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:38.084967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df1f3b-b86e-4cb6-9233-91a77c620b72 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:38.096005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d05c9-2e6f-4f07-9624-29577ad180bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:38.099312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d05c9-2e6f-4f07-9624-29577ad180bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:38.100061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d05c9-2e6f-4f07-9624-29577ad180bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:38.100618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d05c9-2e6f-4f07-9624-29577ad180bb admin admin] PATH_INFO: `/v3/projects/ac27bd2e81e743c9aa1563ad8bf65397/users/9fde8300e72f4cd9845c78d26889d1bc/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:38.127693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d05c9-2e6f-4f07-9624-29577ad180bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac27bd2e81e743c9aa1563ad8bf65397, user_id=9fde8300e72f4cd9845c78d26889d1bc, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:38.132537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d05c9-2e6f-4f07-9624-29577ad180bb admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:38.156409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 961/1912] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:38 2022] PUT /identity/v3/projects/ac27bd2e81e743c9aa1563ad8bf65397/users/9fde8300e72f4cd9845c78d26889d1bc/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:38.171335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf1c89-4fbd-49cb-8178-23a22c8369bf None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:38.171774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf1c89-4fbd-49cb-8178-23a22c8369bf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:38.172198 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf1c89-4fbd-49cb-8178-23a22c8369bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:38.223908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:38.233829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8bbf1c89-4fbd-49cb-8178-23a22c8369bf None None] MFA Rules not processed for user `9fde8300e72f4cd9845c78d26889d1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:38.237636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8bbf1c89-4fbd-49cb-8178-23a22c8369bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:38.376427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 952/1913] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:38.382755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d05c9-2e6f-4f07-9624-29577ad180bb admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:38.521383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf1c89-4fbd-49cb-8178-23a22c8369bf None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:38.529182 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8bbf1c89-4fbd-49cb-8178-23a22c8369bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:38.550615 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d05c9-2e6f-4f07-9624-29577ad180bb admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:38.560920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62805f-3250-4aa3-8325-08b3ac8f9ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:38.561657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62805f-3250-4aa3-8325-08b3ac8f9ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:38.561956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62805f-3250-4aa3-8325-08b3ac8f9ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:38.562553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62805f-3250-4aa3-8325-08b3ac8f9ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:38.564083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62805f-3250-4aa3-8325-08b3ac8f9ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:38.568062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62805f-3250-4aa3-8325-08b3ac8f9ce5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:38.592820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf1c89-4fbd-49cb-8178-23a22c8369bf None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:38.615708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:38.616997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:38.617699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:38.618306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] PATH_INFO: `/v3/projects/89c03ec164f54299a4f043655261f53d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:38.623638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c03ec164f54299a4f043655261f53d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:38.627830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:38.711947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 962/1914] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:38 2022] POST /identity/v3/projects => generated 381 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:38.714118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62805f-3250-4aa3-8325-08b3ac8f9ce5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:38.811729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:38.821828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c03ec164f54299a4f043655261f53d', 'request_id': 'req-0544378b-18f9-4754-802a-1528a30cb723'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:38.847532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c03ec164f54299a4f043655261f53d', 'request_id': 'req-0544378b-18f9-4754-802a-1528a30cb723'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:38.872768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c03ec164f54299a4f043655261f53d', 'request_id': 'req-0544378b-18f9-4754-802a-1528a30cb723'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:38.896522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62805f-3250-4aa3-8325-08b3ac8f9ce5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:38.920904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] The token cache is being invalidate because project 89c03ec164f54299a4f043655261f53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:38.921383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:38.929043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:38.932348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 953/1915] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:38 2022] DELETE /identity/v3/projects/89c03ec164f54299a4f043655261f53d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:38.938520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:38.941494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:39.023341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6b2ed-3764-4146-8069-eb6638bdbf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:39.024161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b2ed-3764-4146-8069-eb6638bdbf08 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:39.024723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b2ed-3764-4146-8069-eb6638bdbf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:39.025008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b2ed-3764-4146-8069-eb6638bdbf08 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:39.025705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6b2ed-3764-4146-8069-eb6638bdbf08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:39.027983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6b2ed-3764-4146-8069-eb6638bdbf08 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:39.073822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 963/1916] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:38 2022] POST /identity/v3/users => generated 297 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:39.078005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6b2ed-3764-4146-8069-eb6638bdbf08 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:39.083679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6bd6b2ed-3764-4146-8069-eb6638bdbf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:39.096430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6b2ed-3764-4146-8069-eb6638bdbf08 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:39.105656 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b9f28-39c4-4d72-97ec-37126cbebd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:39.106253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544378b-18f9-4754-802a-1528a30cb723 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:39.106841 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b9f28-39c4-4d72-97ec-37126cbebd2c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:39.111247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b9f28-39c4-4d72-97ec-37126cbebd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:39.111247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b9f28-39c4-4d72-97ec-37126cbebd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:39.111247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b9f28-39c4-4d72-97ec-37126cbebd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:39.112569 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b9f28-39c4-4d72-97ec-37126cbebd2c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:39.116670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:39.117436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:39.117782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:39.118118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] PATH_INFO: `/v3/users/1f73e6cbf9e8415eb95374c88473a508` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:39.119645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f73e6cbf9e8415eb95374c88473a508)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:39.122382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:39.155613 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 964/1917] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:39.157337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b9f28-39c4-4d72-97ec-37126cbebd2c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:39.179099 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b9f28-39c4-4d72-97ec-37126cbebd2c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:39.182815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:39.193560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1b6cc-8573-4dfe-a39f-cb5b371c83c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:39.194910 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1b6cc-8573-4dfe-a39f-cb5b371c83c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:39.195763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1b6cc-8573-4dfe-a39f-cb5b371c83c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:39.195963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1b6cc-8573-4dfe-a39f-cb5b371c83c6 admin admin] PATH_INFO: `/v3/projects/13df3a00788f44839845c3d463ee081e/users/d8d2b69d54064763993b845a1b545349/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:39.220861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f73e6cbf9e8415eb95374c88473a508'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.222153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f73e6cbf9e8415eb95374c88473a508'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.223603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f73e6cbf9e8415eb95374c88473a508'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.227050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1b6cc-8573-4dfe-a39f-cb5b371c83c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13df3a00788f44839845c3d463ee081e, user_id=d8d2b69d54064763993b845a1b545349, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:39.232436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1b6cc-8573-4dfe-a39f-cb5b371c83c6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:39.253825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f73e6cbf9e8415eb95374c88473a508'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.262759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 965/1918] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:39 2022] PUT /identity/v3/projects/13df3a00788f44839845c3d463ee081e/users/d8d2b69d54064763993b845a1b545349/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:39.265799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1b6cc-8573-4dfe-a39f-cb5b371c83c6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:39.269803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bda1b6cc-8573-4dfe-a39f-cb5b371c83c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:39.273772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f73e6cbf9e8415eb95374c88473a508'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.301847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 954/1919] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:38 2022] DELETE /identity/v3/users/1f73e6cbf9e8415eb95374c88473a508 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:39.386872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:39.389071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:39.478285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1b6cc-8573-4dfe-a39f-cb5b371c83c6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:39.600996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f2feb-1b9b-4108-9c1c-b1aa3092ed9c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:39.621206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:39.622682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:39.623384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:39.624062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] PATH_INFO: `/v3/projects/a4d262926a5548dc90ee44b7a735406f` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:39.627370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d262926a5548dc90ee44b7a735406f)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:39.631858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:39.650027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:39.738899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502694c-755c-4470-98a6-0e1d6f0ecc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:39.740264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502694c-755c-4470-98a6-0e1d6f0ecc52 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:39.740604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502694c-755c-4470-98a6-0e1d6f0ecc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:39.741051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502694c-755c-4470-98a6-0e1d6f0ecc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:39.746595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502694c-755c-4470-98a6-0e1d6f0ecc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:39.755887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502694c-755c-4470-98a6-0e1d6f0ecc52 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:39.789142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 966/1920] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:39.790825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502694c-755c-4470-98a6-0e1d6f0ecc52 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:39.793806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d262926a5548dc90ee44b7a735406f', 'request_id': 'req-a6ab7dce-046d-403f-8fdd-d99a4a94760b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.811418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502694c-755c-4470-98a6-0e1d6f0ecc52 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:39.811663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d262926a5548dc90ee44b7a735406f', 'request_id': 'req-a6ab7dce-046d-403f-8fdd-d99a4a94760b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.827622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d262926a5548dc90ee44b7a735406f', 'request_id': 'req-a6ab7dce-046d-403f-8fdd-d99a4a94760b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.870489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] The token cache is being invalidate because project a4d262926a5548dc90ee44b7a735406f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:39.870892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.872123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:39.875553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 955/1921] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:39 2022] DELETE /identity/v3/projects/a4d262926a5548dc90ee44b7a735406f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:39.881647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:39.884387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:39.985250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965adc9d-2561-40f7-8ecb-c97027760887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:39.986114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965adc9d-2561-40f7-8ecb-c97027760887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:39.986606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965adc9d-2561-40f7-8ecb-c97027760887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:39.987162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965adc9d-2561-40f7-8ecb-c97027760887 admin admin] PATH_INFO: `/v3/projects/13df3a00788f44839845c3d463ee081e/users/d8d2b69d54064763993b845a1b545349/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:39.993018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965adc9d-2561-40f7-8ecb-c97027760887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13df3a00788f44839845c3d463ee081e, user_id=d8d2b69d54064763993b845a1b545349, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:40.003455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965adc9d-2561-40f7-8ecb-c97027760887 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:40.036247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:40.044461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 967/1922] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:39 2022] PUT /identity/v3/projects/13df3a00788f44839845c3d463ee081e/users/d8d2b69d54064763993b845a1b545349/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:40.066459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b538b5-29da-4180-a5f1-5bb62f77ef23 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:40.067324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b538b5-29da-4180-a5f1-5bb62f77ef23 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:40.067923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b538b5-29da-4180-a5f1-5bb62f77ef23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:40.086353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab7dce-046d-403f-8fdd-d99a4a94760b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:40.145398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-59b538b5-29da-4180-a5f1-5bb62f77ef23 None None] MFA Rules not processed for user `d8d2b69d54064763993b845a1b545349`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:40.147700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-59b538b5-29da-4180-a5f1-5bb62f77ef23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:40.191002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:40.191869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:40.191996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:40.192248 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] PATH_INFO: `/v3/users/74083dc1e6fb4fcc85866867dc9fd4d3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:40.193867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74083dc1e6fb4fcc85866867dc9fd4d3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:40.199358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:40.292753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74083dc1e6fb4fcc85866867dc9fd4d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.294119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74083dc1e6fb4fcc85866867dc9fd4d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.295199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74083dc1e6fb4fcc85866867dc9fd4d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.323322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74083dc1e6fb4fcc85866867dc9fd4d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.326905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 968/1923] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:40.328797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b538b5-29da-4180-a5f1-5bb62f77ef23 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:40.334717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-59b538b5-29da-4180-a5f1-5bb62f77ef23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:40.345217 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74083dc1e6fb4fcc85866867dc9fd4d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.358428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b538b5-29da-4180-a5f1-5bb62f77ef23 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:40.366400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:40.367921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:40.374233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:40.375692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 956/1924] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:39 2022] DELETE /identity/v3/users/74083dc1e6fb4fcc85866867dc9fd4d3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:40.375861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] PATH_INFO: `/v3/projects/969bb9e2207a4a03a1e4ebab76f217a4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:40.376010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:40.376578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969bb9e2207a4a03a1e4ebab76f217a4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:40.381524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:40.390114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:40.538233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969bb9e2207a4a03a1e4ebab76f217a4', 'request_id': 'req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.551734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:40.564032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969bb9e2207a4a03a1e4ebab76f217a4', 'request_id': 'req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.583957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969bb9e2207a4a03a1e4ebab76f217a4', 'request_id': 'req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.614768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] The token cache is being invalidate because project 969bb9e2207a4a03a1e4ebab76f217a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:40.615338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.616343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b9d5a06-91af-458e-aeb4-e4e29629bcc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:40.619505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 969/1925] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:40 2022] DELETE /identity/v3/projects/969bb9e2207a4a03a1e4ebab76f217a4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:40.625857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db663cdb-aef8-4ac7-8e3c-5cc9166c3db2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:40.626333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db663cdb-aef8-4ac7-8e3c-5cc9166c3db2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:40.626859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db663cdb-aef8-4ac7-8e3c-5cc9166c3db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:40.640029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccf7dc-2fef-46e5-9071-4091185c54f9 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:40.660265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-db663cdb-aef8-4ac7-8e3c-5cc9166c3db2 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:40.666141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-db663cdb-aef8-4ac7-8e3c-5cc9166c3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:40.685478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:40.824658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 970/1926] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:40.835451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235c15-960b-446a-9365-f1a36306c858 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:40.836188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235c15-960b-446a-9365-f1a36306c858 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:40.836677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235c15-960b-446a-9365-f1a36306c858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:40.877265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:40.878572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:40.879167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:40.879842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:40.887077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9a235c15-960b-446a-9365-f1a36306c858 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:40.890048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9a235c15-960b-446a-9365-f1a36306c858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:40.899646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:40.919550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 971/1927] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:40.933175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a235c15-960b-446a-9365-f1a36306c858 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:40.953317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a235c15-960b-446a-9365-f1a36306c858 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:40.970588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01095b5-9c9c-40d8-8e1d-3cb33ff2d0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:40.971656 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01095b5-9c9c-40d8-8e1d-3cb33ff2d0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:40.972079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01095b5-9c9c-40d8-8e1d-3cb33ff2d0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:40.972337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01095b5-9c9c-40d8-8e1d-3cb33ff2d0c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:40.973671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01095b5-9c9c-40d8-8e1d-3cb33ff2d0c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:40.973903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01095b5-9c9c-40d8-8e1d-3cb33ff2d0c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:40.978459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01095b5-9c9c-40d8-8e1d-3cb33ff2d0c9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:41.025377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 972/1928] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:41.028258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01095b5-9c9c-40d8-8e1d-3cb33ff2d0c9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:41.049944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01095b5-9c9c-40d8-8e1d-3cb33ff2d0c9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:41.066680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:41.066680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:41.069042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d70ecd-b3ad-4e86-94ab-ec665e9eaff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:41.077027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70ecd-b3ad-4e86-94ab-ec665e9eaff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.077027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70ecd-b3ad-4e86-94ab-ec665e9eaff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.077027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70ecd-b3ad-4e86-94ab-ec665e9eaff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.077027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d70ecd-b3ad-4e86-94ab-ec665e9eaff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:41.080385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d70ecd-b3ad-4e86-94ab-ec665e9eaff0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:41.082336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 957/1929] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:41.119107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:41.121304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:41.142637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 973/1930] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:41 2022] POST /identity/v3/projects => generated 409 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:41.144050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d70ecd-b3ad-4e86-94ab-ec665e9eaff0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:41.169922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb57c5-8c09-416b-8551-21b7ad0ac907 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:41.275269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d70ecd-b3ad-4e86-94ab-ec665e9eaff0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:41.292287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2c474-d70a-441b-8281-2540767e0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:41.293275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2c474-d70a-441b-8281-2540767e0d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.293718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2c474-d70a-441b-8281-2540767e0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.294266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2c474-d70a-441b-8281-2540767e0d92 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.296491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2c474-d70a-441b-8281-2540767e0d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:41.297243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:41.298190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.298623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.299147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] PATH_INFO: `/v3/projects/24250839263945da93a56981327e7613` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.300569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=24250839263945da93a56981327e7613)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:41.301682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2c474-d70a-441b-8281-2540767e0d92 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:41.303749 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:41.347584 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 974/1931] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:41 2022] POST /identity/v3/users => generated 305 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:41.349481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2c474-d70a-441b-8281-2540767e0d92 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:41.354863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e8b2c474-d70a-441b-8281-2540767e0d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:41.387261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24250839263945da93a56981327e7613', 'request_id': 'req-79992845-9fe5-49d1-bae4-5990e0e54cad'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:41.397512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24250839263945da93a56981327e7613', 'request_id': 'req-79992845-9fe5-49d1-bae4-5990e0e54cad'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:41.412700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24250839263945da93a56981327e7613', 'request_id': 'req-79992845-9fe5-49d1-bae4-5990e0e54cad'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:41.423609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:41.429586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:41.445526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] The token cache is being invalidate because project 24250839263945da93a56981327e7613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:41.446522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:41.448328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:41.451395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 958/1932] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:41 2022] DELETE /identity/v3/projects/24250839263945da93a56981327e7613 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:41.459113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:41.461197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:41.511786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2c474-d70a-441b-8281-2540767e0d92 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:41.590566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79992845-9fe5-49d1-bae4-5990e0e54cad admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:41.599332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743990cf-7859-4fc8-a9da-afad3b6366a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:41.600121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743990cf-7859-4fc8-a9da-afad3b6366a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.601109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743990cf-7859-4fc8-a9da-afad3b6366a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.603474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743990cf-7859-4fc8-a9da-afad3b6366a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.603799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743990cf-7859-4fc8-a9da-afad3b6366a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:41.605835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743990cf-7859-4fc8-a9da-afad3b6366a4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:41.619305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 959/1933] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:41.620849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e2d77-e9f0-4c8e-8c00-37536e34143d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.621255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e2d77-e9f0-4c8e-8c00-37536e34143d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.621676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e2d77-e9f0-4c8e-8c00-37536e34143d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.639218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffefea3-8088-47e4-a50e-71e78b67f748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:41.639628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffefea3-8088-47e4-a50e-71e78b67f748 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.640026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffefea3-8088-47e4-a50e-71e78b67f748 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.640489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffefea3-8088-47e4-a50e-71e78b67f748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.643338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6ffefea3-8088-47e4-a50e-71e78b67f748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:41.648609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-674e2d77-e9f0-4c8e-8c00-37536e34143d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:41.650579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-674e2d77-e9f0-4c8e-8c00-37536e34143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:41.670404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 960/1934] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:41.670404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e2d77-e9f0-4c8e-8c00-37536e34143d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:41.679628 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e2d77-e9f0-4c8e-8c00-37536e34143d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:41.686534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474609a-4eb4-42ca-a0dc-b4ccfcaafe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:41.687638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474609a-4eb4-42ca-a0dc-b4ccfcaafe5a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.688053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474609a-4eb4-42ca-a0dc-b4ccfcaafe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.688416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474609a-4eb4-42ca-a0dc-b4ccfcaafe5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.689287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474609a-4eb4-42ca-a0dc-b4ccfcaafe5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:41.691761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474609a-4eb4-42ca-a0dc-b4ccfcaafe5a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:41.710372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 961/1935] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:41.712741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd1711-9c33-4eec-8afa-96f31135f60e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.713219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd1711-9c33-4eec-8afa-96f31135f60e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.714472 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd1711-9c33-4eec-8afa-96f31135f60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.748905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-75dd1711-9c33-4eec-8afa-96f31135f60e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:41.750456 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-75dd1711-9c33-4eec-8afa-96f31135f60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:41.763689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 962/1936] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:41.765780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd1711-9c33-4eec-8afa-96f31135f60e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:41.779907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd1711-9c33-4eec-8afa-96f31135f60e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:41.786302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a7e90-d330-49a5-8f76-c027a5704699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:41.787504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7e90-d330-49a5-8f76-c027a5704699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.787990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7e90-d330-49a5-8f76-c027a5704699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.788441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7e90-d330-49a5-8f76-c027a5704699 admin admin] PATH_INFO: `/v3/projects/5ad2074fb51949698df7ae173e9d2e50/users/3b57807a9b724b988e20176fdc6b5dc7/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.795553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffefea3-8088-47e4-a50e-71e78b67f748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:41.798519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffefea3-8088-47e4-a50e-71e78b67f748 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:41.821542 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a7e90-d330-49a5-8f76-c027a5704699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad2074fb51949698df7ae173e9d2e50, user_id=3b57807a9b724b988e20176fdc6b5dc7, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:41.824999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a7e90-d330-49a5-8f76-c027a5704699 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:41.826822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 975/1937] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:41.828180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffefea3-8088-47e4-a50e-71e78b67f748 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:41.861788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 963/1938] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:41 2022] PUT /identity/v3/projects/5ad2074fb51949698df7ae173e9d2e50/users/3b57807a9b724b988e20176fdc6b5dc7/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:41.867285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffefea3-8088-47e4-a50e-71e78b67f748 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:41.876137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf574b65-df28-4d00-9423-e00313abaf3f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:41.876475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf574b65-df28-4d00-9423-e00313abaf3f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:41.876686 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf574b65-df28-4d00-9423-e00313abaf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:41.947043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cf574b65-df28-4d00-9423-e00313abaf3f None None] MFA Rules not processed for user `3b57807a9b724b988e20176fdc6b5dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:41.964199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cf574b65-df28-4d00-9423-e00313abaf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:42.116737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221383c-c6ac-4494-b1ba-64b94bb16d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:42.118244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221383c-c6ac-4494-b1ba-64b94bb16d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:42.118709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221383c-c6ac-4494-b1ba-64b94bb16d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:42.119222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221383c-c6ac-4494-b1ba-64b94bb16d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:42.122631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221383c-c6ac-4494-b1ba-64b94bb16d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:42.126172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221383c-c6ac-4494-b1ba-64b94bb16d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:42.136370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221383c-c6ac-4494-b1ba-64b94bb16d94 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:42.178173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 976/1939] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:42.189222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221383c-c6ac-4494-b1ba-64b94bb16d94 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.190111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 964/1940] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:41 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:42.197417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf574b65-df28-4d00-9423-e00313abaf3f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.219229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221383c-c6ac-4494-b1ba-64b94bb16d94 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:42.223559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf574b65-df28-4d00-9423-e00313abaf3f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:42.232752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537b6e6-66d2-41f2-ae25-a8c936fab81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:42.238573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537b6e6-66d2-41f2-ae25-a8c936fab81c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:42.239110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537b6e6-66d2-41f2-ae25-a8c936fab81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:42.239377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537b6e6-66d2-41f2-ae25-a8c936fab81c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:42.240227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537b6e6-66d2-41f2-ae25-a8c936fab81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:42.242684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b3daf-156d-49e7-b937-0b37465ad9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:42.243326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b3daf-156d-49e7-b937-0b37465ad9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:42.243605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b3daf-156d-49e7-b937-0b37465ad9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:42.243876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b3daf-156d-49e7-b937-0b37465ad9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:42.244544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b3daf-156d-49e7-b937-0b37465ad9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:42.246516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b3daf-156d-49e7-b937-0b37465ad9b5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:42.249007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537b6e6-66d2-41f2-ae25-a8c936fab81c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:42.339794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 977/1941] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:42 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:42.346441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537b6e6-66d2-41f2-ae25-a8c936fab81c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.365197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 965/1942] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:42 2022] POST /identity/v3/projects => generated 409 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:42.368215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b3daf-156d-49e7-b937-0b37465ad9b5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.404314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:42.425492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:42.601405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537b6e6-66d2-41f2-ae25-a8c936fab81c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:42.653959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b3daf-156d-49e7-b937-0b37465ad9b5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:42.675336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2570-367c-41d7-bc25-8673c2e2e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:42.676667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2570-367c-41d7-bc25-8673c2e2e5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:42.677152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2570-367c-41d7-bc25-8673c2e2e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:42.677531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2570-367c-41d7-bc25-8673c2e2e5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:42.678550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a2570-367c-41d7-bc25-8673c2e2e5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:42.685923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a2570-367c-41d7-bc25-8673c2e2e5d3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:42.711980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80283e8-12ce-4142-93e8-562a5acf21f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:42.712523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80283e8-12ce-4142-93e8-562a5acf21f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:42.712802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80283e8-12ce-4142-93e8-562a5acf21f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:42.713074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80283e8-12ce-4142-93e8-562a5acf21f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:42.713752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80283e8-12ce-4142-93e8-562a5acf21f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:42.715828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80283e8-12ce-4142-93e8-562a5acf21f2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:42.743880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 966/1943] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:42 2022] POST /identity/v3/users => generated 311 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:42.745047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 978/1944] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:42 2022] POST /identity/v3/users => generated 293 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:42.745737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2570-367c-41d7-bc25-8673c2e2e5d3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.748266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80283e8-12ce-4142-93e8-562a5acf21f2 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.750411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-200a2570-367c-41d7-bc25-8673c2e2e5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:42.762044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80283e8-12ce-4142-93e8-562a5acf21f2 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:42.768510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74794f-b9a4-42c3-a35f-33e077d2c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:42.769148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74794f-b9a4-42c3-a35f-33e077d2c3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:42.769490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74794f-b9a4-42c3-a35f-33e077d2c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:42.769834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74794f-b9a4-42c3-a35f-33e077d2c3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:42.770726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74794f-b9a4-42c3-a35f-33e077d2c3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:42.772408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74794f-b9a4-42c3-a35f-33e077d2c3a4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:42.775518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2570-367c-41d7-bc25-8673c2e2e5d3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:42.790239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 979/1945] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:42.790239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74794f-b9a4-42c3-a35f-33e077d2c3a4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.790556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:42.790556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:42.790556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:42.790836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] PATH_INFO: `/v3/users/9fde8300e72f4cd9845c78d26889d1bc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:42.792910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fde8300e72f4cd9845c78d26889d1bc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:42.796534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:42.803791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74794f-b9a4-42c3-a35f-33e077d2c3a4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:42.810257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2d738-ec4a-4c84-a60e-56080c4b5cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:42.811091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2d738-ec4a-4c84-a60e-56080c4b5cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:42.811638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2d738-ec4a-4c84-a60e-56080c4b5cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:42.812011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2d738-ec4a-4c84-a60e-56080c4b5cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:42.813147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2d738-ec4a-4c84-a60e-56080c4b5cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:42.815207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2d738-ec4a-4c84-a60e-56080c4b5cc1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:42.838447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 980/1946] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:42.838447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2d738-ec4a-4c84-a60e-56080c4b5cc1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.849450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2d738-ec4a-4c84-a60e-56080c4b5cc1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:42.862563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763e40f-34b1-4d19-b40f-7a1defe31086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:42.864326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763e40f-34b1-4d19-b40f-7a1defe31086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:42.865049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763e40f-34b1-4d19-b40f-7a1defe31086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:42.865725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763e40f-34b1-4d19-b40f-7a1defe31086 admin admin] PATH_INFO: `/v3/projects/4b00185215da4144ae262506d663753b/users/b81e8347b290417b85b6c1435f852528/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:42.889855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fde8300e72f4cd9845c78d26889d1bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:42.890826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fde8300e72f4cd9845c78d26889d1bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:42.891551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fde8300e72f4cd9845c78d26889d1bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:42.907699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763e40f-34b1-4d19-b40f-7a1defe31086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b00185215da4144ae262506d663753b, user_id=b81e8347b290417b85b6c1435f852528, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:42.913140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763e40f-34b1-4d19-b40f-7a1defe31086 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:42.913852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fde8300e72f4cd9845c78d26889d1bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:42.925144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fde8300e72f4cd9845c78d26889d1bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:42.949775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 981/1947] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:42 2022] PUT /identity/v3/projects/4b00185215da4144ae262506d663753b/users/b81e8347b290417b85b6c1435f852528/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:42.949775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763e40f-34b1-4d19-b40f-7a1defe31086 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.950153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b763e40f-34b1-4d19-b40f-7a1defe31086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:42.967714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 967/1948] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:42 2022] DELETE /identity/v3/users/9fde8300e72f4cd9845c78d26889d1bc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:42.969710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:42.974677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:43.105225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763e40f-34b1-4d19-b40f-7a1defe31086 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:43.119503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8949aab-bdfe-4c40-9683-1fa0fafec2de admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:43.124573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c1b4b-a65e-43f5-9eb1-78c1999b5d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:43.125916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c683a-1c8c-42d1-a75f-df90302dd644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:43.126878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c683a-1c8c-42d1-a75f-df90302dd644 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:43.127046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c683a-1c8c-42d1-a75f-df90302dd644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:43.127357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c683a-1c8c-42d1-a75f-df90302dd644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:43.127535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c1b4b-a65e-43f5-9eb1-78c1999b5d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:43.127977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c1b4b-a65e-43f5-9eb1-78c1999b5d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:43.128140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c683a-1c8c-42d1-a75f-df90302dd644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:43.128490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c1b4b-a65e-43f5-9eb1-78c1999b5d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:43.129784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c683a-1c8c-42d1-a75f-df90302dd644 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:43.131617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c1b4b-a65e-43f5-9eb1-78c1999b5d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:43.138163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c1b4b-a65e-43f5-9eb1-78c1999b5d04 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:43.142304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:43.144501 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 968/1949] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:43.145997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b962-6812-425f-be9d-9cc3168494ee None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:43.146402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b962-6812-425f-be9d-9cc3168494ee None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:43.146645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b962-6812-425f-be9d-9cc3168494ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:43.167356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 982/1950] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:43.169425 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c1b4b-a65e-43f5-9eb1-78c1999b5d04 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:43.184695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0509b962-6812-425f-be9d-9cc3168494ee None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:43.186873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0509b962-6812-425f-be9d-9cc3168494ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:43.190646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c1b4b-a65e-43f5-9eb1-78c1999b5d04 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:43.206503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 969/1951] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:43.206503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b962-6812-425f-be9d-9cc3168494ee None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:43.216248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a268ffc-83ee-4b79-926c-cbae610d3901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:43.216248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a268ffc-83ee-4b79-926c-cbae610d3901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:43.216248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a268ffc-83ee-4b79-926c-cbae610d3901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:43.216797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a268ffc-83ee-4b79-926c-cbae610d3901 admin admin] PATH_INFO: `/v3/projects/4b00185215da4144ae262506d663753b/users/b81e8347b290417b85b6c1435f852528/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:43.219349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a268ffc-83ee-4b79-926c-cbae610d3901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b00185215da4144ae262506d663753b, user_id=b81e8347b290417b85b6c1435f852528, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:43.222149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:43.224448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a268ffc-83ee-4b79-926c-cbae610d3901 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:43.232443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b962-6812-425f-be9d-9cc3168494ee None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:43.248495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc7c5e-a921-462d-bc25-b3f1604e39c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:43.250112 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7c5e-a921-462d-bc25-b3f1604e39c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:43.250603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7c5e-a921-462d-bc25-b3f1604e39c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:43.252478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7c5e-a921-462d-bc25-b3f1604e39c7 admin admin] PATH_INFO: `/v3/projects/7734485d98644577a84f7c8b70ac71c7/users/a9a8fd041b004c46b1c65f0a030674cd/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:43.262790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 983/1952] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:43 2022] PUT /identity/v3/projects/4b00185215da4144ae262506d663753b/users/b81e8347b290417b85b6c1435f852528/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:43.269786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a268ffc-83ee-4b79-926c-cbae610d3901 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:43.275485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2a268ffc-83ee-4b79-926c-cbae610d3901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:43.297884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc7c5e-a921-462d-bc25-b3f1604e39c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7734485d98644577a84f7c8b70ac71c7, user_id=a9a8fd041b004c46b1c65f0a030674cd, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:43.304498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc7c5e-a921-462d-bc25-b3f1604e39c7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:43.350712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 970/1953] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:43 2022] PUT /identity/v3/projects/7734485d98644577a84f7c8b70ac71c7/users/a9a8fd041b004c46b1c65f0a030674cd/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:43.350712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286439fb-d3a5-451c-be0a-d05e3168a2da None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:43.351204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286439fb-d3a5-451c-be0a-d05e3168a2da None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:43.351672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286439fb-d3a5-451c-be0a-d05e3168a2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:43.427021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a268ffc-83ee-4b79-926c-cbae610d3901 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:43.433744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-286439fb-d3a5-451c-be0a-d05e3168a2da None None] MFA Rules not processed for user `b81e8347b290417b85b6c1435f852528`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:43.437612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-286439fb-d3a5-451c-be0a-d05e3168a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:43.559689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fde2c-08f3-446e-a3ec-ff7b7a552b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:43.559689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fde2c-08f3-446e-a3ec-ff7b7a552b05 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:43.559689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fde2c-08f3-446e-a3ec-ff7b7a552b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:43.559689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fde2c-08f3-446e-a3ec-ff7b7a552b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:43.678129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 971/1954] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:43 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:43.681637 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb16a5-581b-406f-af5e-20b736bc369c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:43.681848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb16a5-581b-406f-af5e-20b736bc369c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:43.684040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb16a5-581b-406f-af5e-20b736bc369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:43.799023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6bfb16a5-581b-406f-af5e-20b736bc369c None None] MFA Rules not processed for user `a9a8fd041b004c46b1c65f0a030674cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:43.800394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6bfb16a5-581b-406f-af5e-20b736bc369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:43.804583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fde2c-08f3-446e-a3ec-ff7b7a552b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:43.807982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fde2c-08f3-446e-a3ec-ff7b7a552b05 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:43.829217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 984/1955] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:43.830228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fde2c-08f3-446e-a3ec-ff7b7a552b05 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:43.832707 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-466fde2c-08f3-446e-a3ec-ff7b7a552b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:44.002875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 972/1956] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:44.009971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb16a5-581b-406f-af5e-20b736bc369c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:44.064146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fde2c-08f3-446e-a3ec-ff7b7a552b05 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:44.073942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb16a5-581b-406f-af5e-20b736bc369c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:44.088139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a2f83-6581-4077-ac4f-ff49297b36ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:44.089287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be16e50-ca74-4365-b043-4352e75c9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:44.089787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a2f83-6581-4077-ac4f-ff49297b36ee service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:44.090310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be16e50-ca74-4365-b043-4352e75c9d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:44.090925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a2f83-6581-4077-ac4f-ff49297b36ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:44.091083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be16e50-ca74-4365-b043-4352e75c9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:44.091713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be16e50-ca74-4365-b043-4352e75c9d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:44.092633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a2f83-6581-4077-ac4f-ff49297b36ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:44.092900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be16e50-ca74-4365-b043-4352e75c9d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:44.098168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be16e50-ca74-4365-b043-4352e75c9d41 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:44.127991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:44.145760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a2f83-6581-4077-ac4f-ff49297b36ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:44.150438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a2f83-6581-4077-ac4f-ff49297b36ee service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:44.188920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 973/1957] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:44 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:44.195275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be16e50-ca74-4365-b043-4352e75c9d41 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:44.209327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 985/1958] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:43 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:44.356099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:44.460158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be16e50-ca74-4365-b043-4352e75c9d41 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:44.485575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a58b95-3070-4626-b81d-c97260593228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:44.486594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58b95-3070-4626-b81d-c97260593228 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:44.487289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58b95-3070-4626-b81d-c97260593228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:44.487547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58b95-3070-4626-b81d-c97260593228 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:44.488892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a58b95-3070-4626-b81d-c97260593228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:44.502130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a58b95-3070-4626-b81d-c97260593228 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:44.606212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 974/1959] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:44 2022] POST /identity/v3/users => generated 300 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:44.612097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a2f83-6581-4077-ac4f-ff49297b36ee service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:44.669849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a2f83-6581-4077-ac4f-ff49297b36ee service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:44.684014 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25969d-4759-424f-bf8b-88359ce46ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:44.684925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25969d-4759-424f-bf8b-88359ce46ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:44.685055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25969d-4759-424f-bf8b-88359ce46ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:44.685363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25969d-4759-424f-bf8b-88359ce46ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:44.686024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25969d-4759-424f-bf8b-88359ce46ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:44.688425 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25969d-4759-424f-bf8b-88359ce46ac5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:44.702531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 986/1960] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:44.708400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a58b95-3070-4626-b81d-c97260593228 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:44.723405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25969d-4759-424f-bf8b-88359ce46ac5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:44.736635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a58b95-3070-4626-b81d-c97260593228 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:44.753462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02797b8-cf0a-4745-8cdc-92cd35879ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:44.754628 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02797b8-cf0a-4745-8cdc-92cd35879ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:44.755120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02797b8-cf0a-4745-8cdc-92cd35879ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:44.755564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02797b8-cf0a-4745-8cdc-92cd35879ca1 admin admin] PATH_INFO: `/v3/projects/850238c253924f0fbed0bfe9f119207a/users/3e40cb3aee524689af81a4063a6561c4/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:44.806745 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02797b8-cf0a-4745-8cdc-92cd35879ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850238c253924f0fbed0bfe9f119207a, user_id=3e40cb3aee524689af81a4063a6561c4, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:44.814071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02797b8-cf0a-4745-8cdc-92cd35879ca1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:44.849716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 975/1961] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:44 2022] PUT /identity/v3/projects/850238c253924f0fbed0bfe9f119207a/users/3e40cb3aee524689af81a4063a6561c4/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:44.856317 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02797b8-cf0a-4745-8cdc-92cd35879ca1 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:44.857180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25969d-4759-424f-bf8b-88359ce46ac5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:44.966277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02797b8-cf0a-4745-8cdc-92cd35879ca1 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:44.975261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40716dc9-b5a1-40c5-ad0e-151b24f401f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:44.976808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40716dc9-b5a1-40c5-ad0e-151b24f401f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:44.979086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40716dc9-b5a1-40c5-ad0e-151b24f401f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:44.979802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40716dc9-b5a1-40c5-ad0e-151b24f401f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:44.982083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40716dc9-b5a1-40c5-ad0e-151b24f401f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:44.987867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40716dc9-b5a1-40c5-ad0e-151b24f401f5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:44.991477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df89cc0-d53e-4f83-b8f6-b607da05895e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:44.992324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89cc0-d53e-4f83-b8f6-b607da05895e service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:44.993163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89cc0-d53e-4f83-b8f6-b607da05895e service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:44.993685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89cc0-d53e-4f83-b8f6-b607da05895e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:44.996239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6df89cc0-d53e-4f83-b8f6-b607da05895e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:45.014528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 976/1962] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:33:45.016223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40716dc9-b5a1-40c5-ad0e-151b24f401f5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:45.021560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-40716dc9-b5a1-40c5-ad0e-151b24f401f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:45.057540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40716dc9-b5a1-40c5-ad0e-151b24f401f5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:45.067401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:45.068644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:45.069160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:45.069626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] PATH_INFO: `/v3/projects/ac27bd2e81e743c9aa1563ad8bf65397` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:45.071823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac27bd2e81e743c9aa1563ad8bf65397)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:45.074864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:45.157235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df89cc0-d53e-4f83-b8f6-b607da05895e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:45.160286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df89cc0-d53e-4f83-b8f6-b607da05895e service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:45.175211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 987/1963] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:44 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:45.176718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df89cc0-d53e-4f83-b8f6-b607da05895e service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:45.196083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac27bd2e81e743c9aa1563ad8bf65397', 'request_id': 'req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.203467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df89cc0-d53e-4f83-b8f6-b607da05895e service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:45.220014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac27bd2e81e743c9aa1563ad8bf65397', 'request_id': 'req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.232984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac27bd2e81e743c9aa1563ad8bf65397', 'request_id': 'req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.260967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] The token cache is being invalidate because project ac27bd2e81e743c9aa1563ad8bf65397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:45.261386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.263243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.266260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 977/1964] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:45 2022] DELETE /identity/v3/projects/ac27bd2e81e743c9aa1563ad8bf65397 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:45.271452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:45.276367 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:45.301372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:45.316060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ff8b8-48f8-4ede-bb5d-a757bfd5f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:45.318030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ff8b8-48f8-4ede-bb5d-a757bfd5f223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:45.318630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ff8b8-48f8-4ede-bb5d-a757bfd5f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:45.319261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ff8b8-48f8-4ede-bb5d-a757bfd5f223 admin admin] PATH_INFO: `/v3/projects/850238c253924f0fbed0bfe9f119207a/users/3e40cb3aee524689af81a4063a6561c4/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:45.322361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ff8b8-48f8-4ede-bb5d-a757bfd5f223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850238c253924f0fbed0bfe9f119207a, user_id=3e40cb3aee524689af81a4063a6561c4, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:45.322616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:45.325502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ff8b8-48f8-4ede-bb5d-a757bfd5f223 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:45.348439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 988/1965] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:45 2022] PUT /identity/v3/projects/850238c253924f0fbed0bfe9f119207a/users/3e40cb3aee524689af81a4063a6561c4/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:45.371648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c74d6-5c95-4a11-b699-889b97dd8be6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:45.372011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c74d6-5c95-4a11-b699-889b97dd8be6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:45.372210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c74d6-5c95-4a11-b699-889b97dd8be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:45.443682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5e8c74d6-5c95-4a11-b699-889b97dd8be6 None None] MFA Rules not processed for user `3e40cb3aee524689af81a4063a6561c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:45.446005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5e8c74d6-5c95-4a11-b699-889b97dd8be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:45.461487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1e0fd-76dc-422f-b2dc-bc08cef4fa71 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:45.633304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:45.635764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:45.637877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:45.638588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] PATH_INFO: `/v3/users/d8d2b69d54064763993b845a1b545349` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:45.642696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d2b69d54064763993b845a1b545349)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:45.655261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:45.718166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 989/1966] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:45.818907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d2b69d54064763993b845a1b545349'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.820520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d2b69d54064763993b845a1b545349'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.823764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d2b69d54064763993b845a1b545349'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.860138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d2b69d54064763993b845a1b545349'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.879195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d2b69d54064763993b845a1b545349'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:45.935944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 978/1967] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:45 2022] DELETE /identity/v3/users/d8d2b69d54064763993b845a1b545349 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:45.992874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c74d6-5c95-4a11-b699-889b97dd8be6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:45.994714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5e8c74d6-5c95-4a11-b699-889b97dd8be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:46.174046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c74d6-5c95-4a11-b699-889b97dd8be6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:46.244697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:46.245623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:46.245905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:46.246255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:46.249741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:46.314235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:46.355057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:46.359346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:46.378905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 990/1968] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:46.417714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:46.419356 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:46.505269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:46.506766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:46.547027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:46.628926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13708c-a84c-4400-868b-427240aad454 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:46.638096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:46.639270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:46.639728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:46.640183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] PATH_INFO: `/v3/users/a9a8fd041b004c46b1c65f0a030674cd` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:46.648153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f35ae4-0621-44e1-be51-24b475d081ee service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:46.648795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a8fd041b004c46b1c65f0a030674cd)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:46.651763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:46.653868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:46.654565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:46.655069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:46.655374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] PATH_INFO: `/v3/projects/13df3a00788f44839845c3d463ee081e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:46.659637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13df3a00788f44839845c3d463ee081e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:46.662186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:46.764324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13df3a00788f44839845c3d463ee081e', 'request_id': 'req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.777713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13df3a00788f44839845c3d463ee081e', 'request_id': 'req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.783623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a8fd041b004c46b1c65f0a030674cd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.784797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a8fd041b004c46b1c65f0a030674cd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.785902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a8fd041b004c46b1c65f0a030674cd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.791507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13df3a00788f44839845c3d463ee081e', 'request_id': 'req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.811485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a8fd041b004c46b1c65f0a030674cd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.815767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] The token cache is being invalidate because project 13df3a00788f44839845c3d463ee081e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:46.816194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.817267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2fd4c53f-2fa8-472b-ad02-4fb722547a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.819590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 991/1969] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:46 2022] DELETE /identity/v3/projects/13df3a00788f44839845c3d463ee081e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:46.823056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e7f2b59-ec58-4209-aa11-2c406e185a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a8fd041b004c46b1c65f0a030674cd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:46.826510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58917f-7a08-49a0-bdf6-4d6f5f56c2fe None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:46.826984 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58917f-7a08-49a0-bdf6-4d6f5f56c2fe None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:46.827376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58917f-7a08-49a0-bdf6-4d6f5f56c2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:46.846781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 979/1970] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:46 2022] DELETE /identity/v3/users/a9a8fd041b004c46b1c65f0a030674cd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:46.854520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e6c8a-6e07-4d75-984f-9062648a1b66 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:46.855329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e6c8a-6e07-4d75-984f-9062648a1b66 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:46.855894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e6c8a-6e07-4d75-984f-9062648a1b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:46.862474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fd58917f-7a08-49a0-bdf6-4d6f5f56c2fe None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:46.864355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fd58917f-7a08-49a0-bdf6-4d6f5f56c2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:46.890076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ce4e6c8a-6e07-4d75-984f-9062648a1b66 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:46.892437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ce4e6c8a-6e07-4d75-984f-9062648a1b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:46.980481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 992/1971] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:46.993333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd49a5-2998-40c2-88e0-e97b0114bcfd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:46.993627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd49a5-2998-40c2-88e0-e97b0114bcfd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:46.993891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd49a5-2998-40c2-88e0-e97b0114bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:47.017125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 980/1972] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:47.020528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-59fd49a5-2998-40c2-88e0-e97b0114bcfd None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:47.021920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-59fd49a5-2998-40c2-88e0-e97b0114bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:47.029832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e6c8a-6e07-4d75-984f-9062648a1b66 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:47.031302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ce4e6c8a-6e07-4d75-984f-9062648a1b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:47.032503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 993/1973] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:47.039515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd49a5-2998-40c2-88e0-e97b0114bcfd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:47.046279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:47.065537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd49a5-2998-40c2-88e0-e97b0114bcfd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:47.077789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3bc48-c56d-4abb-84d8-9ba56d6e202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:47.079295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3bc48-c56d-4abb-84d8-9ba56d6e202c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:47.080015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3bc48-c56d-4abb-84d8-9ba56d6e202c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:47.080894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3bc48-c56d-4abb-84d8-9ba56d6e202c admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:47.084338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3bc48-c56d-4abb-84d8-9ba56d6e202c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:47.084921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3bc48-c56d-4abb-84d8-9ba56d6e202c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:47.089233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3bc48-c56d-4abb-84d8-9ba56d6e202c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:47.119964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 994/1974] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:33:47.126798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3bc48-c56d-4abb-84d8-9ba56d6e202c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:47.140354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3bc48-c56d-4abb-84d8-9ba56d6e202c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:47.150558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad0ffe-1fc6-4fcf-b671-cb45780ce927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:47.151854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad0ffe-1fc6-4fcf-b671-cb45780ce927 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:47.152346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad0ffe-1fc6-4fcf-b671-cb45780ce927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:47.152900 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad0ffe-1fc6-4fcf-b671-cb45780ce927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:47.154165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad0ffe-1fc6-4fcf-b671-cb45780ce927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:47.158148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad0ffe-1fc6-4fcf-b671-cb45780ce927 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:47.163464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e6c8a-6e07-4d75-984f-9062648a1b66 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:47.169246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f302b-58c9-4bd6-9d40-bb4959a44bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:47.169847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f302b-58c9-4bd6-9d40-bb4959a44bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:47.170174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f302b-58c9-4bd6-9d40-bb4959a44bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:47.170529 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f302b-58c9-4bd6-9d40-bb4959a44bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:47.198067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f302b-58c9-4bd6-9d40-bb4959a44bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:47.200301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f302b-58c9-4bd6-9d40-bb4959a44bd8 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:47.228437 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 995/1976] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:47 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:47.228725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 981/1976] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:47.233715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f302b-58c9-4bd6-9d40-bb4959a44bd8 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:47.261200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f302b-58c9-4bd6-9d40-bb4959a44bd8 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:47.274382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:47.421725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1630f74-1400-4572-b15a-53625f036882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:47.422404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1630f74-1400-4572-b15a-53625f036882 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:47.422821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1630f74-1400-4572-b15a-53625f036882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:47.423020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1630f74-1400-4572-b15a-53625f036882 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:47.424361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1630f74-1400-4572-b15a-53625f036882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:47.426083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1630f74-1400-4572-b15a-53625f036882 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:47.467300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 982/1977] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:47 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:47.472028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad0ffe-1fc6-4fcf-b671-cb45780ce927 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:47.486052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad0ffe-1fc6-4fcf-b671-cb45780ce927 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:47.510009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e49c58-db17-4fba-9b55-9bc7d5d0320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:47.514878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e49c58-db17-4fba-9b55-9bc7d5d0320e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:47.515315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e49c58-db17-4fba-9b55-9bc7d5d0320e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:47.517035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e49c58-db17-4fba-9b55-9bc7d5d0320e admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:47.519722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e49c58-db17-4fba-9b55-9bc7d5d0320e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:47.539817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e49c58-db17-4fba-9b55-9bc7d5d0320e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:47.595177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 996/1978] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:47.598132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1630f74-1400-4572-b15a-53625f036882 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:47.656739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1630f74-1400-4572-b15a-53625f036882 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:47.706192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb57bea-2492-4d14-84f6-d44194711133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:47.707242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb57bea-2492-4d14-84f6-d44194711133 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:47.707703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb57bea-2492-4d14-84f6-d44194711133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:47.708154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb57bea-2492-4d14-84f6-d44194711133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:47.721515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb57bea-2492-4d14-84f6-d44194711133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:47.758450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb57bea-2492-4d14-84f6-d44194711133 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:47.828387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e49c58-db17-4fba-9b55-9bc7d5d0320e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:47.829500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 983/1979] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:47.875561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e49c58-db17-4fba-9b55-9bc7d5d0320e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:47.888958 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c233c3-05e3-48e5-b6fa-fee53944b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:47.891741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c233c3-05e3-48e5-b6fa-fee53944b484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:47.893246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c233c3-05e3-48e5-b6fa-fee53944b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:47.893441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c233c3-05e3-48e5-b6fa-fee53944b484 admin admin] PATH_INFO: `/v3/projects/30db6d523c5c4763933b86c160ea3d87/users/3d824b7cad264484bde1071e4e6306ad/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:47.936164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb57bea-2492-4d14-84f6-d44194711133 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:47.942136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ceb57bea-2492-4d14-84f6-d44194711133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:47.963286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c233c3-05e3-48e5-b6fa-fee53944b484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30db6d523c5c4763933b86c160ea3d87, user_id=3d824b7cad264484bde1071e4e6306ad, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:47.976586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c233c3-05e3-48e5-b6fa-fee53944b484 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:47.985526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb57bea-2492-4d14-84f6-d44194711133 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:47.993457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:47.994159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:47.994506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:47.994864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] PATH_INFO: `/v3/projects/7734485d98644577a84f7c8b70ac71c7` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:47.996312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7734485d98644577a84f7c8b70ac71c7)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:47.998897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:48.022604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 997/1980] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:47 2022] PUT /identity/v3/projects/30db6d523c5c4763933b86c160ea3d87/users/3d824b7cad264484bde1071e4e6306ad/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:48.032439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ced3-7107-4fe9-a595-313c9e4888ba None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:48.032859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ced3-7107-4fe9-a595-313c9e4888ba None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:48.033047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ced3-7107-4fe9-a595-313c9e4888ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:48.115689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a039ced3-7107-4fe9-a595-313c9e4888ba None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:48.117281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a039ced3-7107-4fe9-a595-313c9e4888ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:48.121610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7734485d98644577a84f7c8b70ac71c7', 'request_id': 'req-ed1c05c8-307a-4c30-a607-8a03f8613278'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.151834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7734485d98644577a84f7c8b70ac71c7', 'request_id': 'req-ed1c05c8-307a-4c30-a607-8a03f8613278'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.161976 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7734485d98644577a84f7c8b70ac71c7', 'request_id': 'req-ed1c05c8-307a-4c30-a607-8a03f8613278'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.183834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] The token cache is being invalidate because project 7734485d98644577a84f7c8b70ac71c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:48.184313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.185285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.188200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 984/1981] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:47 2022] DELETE /identity/v3/projects/7734485d98644577a84f7c8b70ac71c7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:48.195060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:48.200641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:48.331241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 998/1982] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:48.363180 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c05c8-307a-4c30-a607-8a03f8613278 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:48.369033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:48.369721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:48.369999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:48.370581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] PATH_INFO: `/v3/users/3e40cb3aee524689af81a4063a6561c4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:48.372442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e40cb3aee524689af81a4063a6561c4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:48.374917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:48.385311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039ced3-7107-4fe9-a595-313c9e4888ba None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:48.388404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a039ced3-7107-4fe9-a595-313c9e4888ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:48.414690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:48.525301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e40cb3aee524689af81a4063a6561c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.530006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e40cb3aee524689af81a4063a6561c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.534832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e40cb3aee524689af81a4063a6561c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.563251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e40cb3aee524689af81a4063a6561c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.595499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039ced3-7107-4fe9-a595-313c9e4888ba None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:48.595716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e40cb3aee524689af81a4063a6561c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:48.613987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72a641-3312-4d3b-bd2f-ebee1f6e5f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:48.615907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72a641-3312-4d3b-bd2f-ebee1f6e5f88 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:48.617666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72a641-3312-4d3b-bd2f-ebee1f6e5f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:48.618063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72a641-3312-4d3b-bd2f-ebee1f6e5f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:48.622379 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5b72a641-3312-4d3b-bd2f-ebee1f6e5f88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:48.636360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 985/1983] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:48 2022] DELETE /identity/v3/users/3e40cb3aee524689af81a4063a6561c4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:48.661904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72a641-3312-4d3b-bd2f-ebee1f6e5f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:48.663838 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72a641-3312-4d3b-bd2f-ebee1f6e5f88 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:48.682572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 999/1984] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:33:49.248769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:49.255970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:49.589202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c16f5c-efe2-4d94-8171-4a3ea2d44f84 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:49.602413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:49.603866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:49.604734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:49.605534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] PATH_INFO: `/v3/projects/850238c253924f0fbed0bfe9f119207a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:49.624225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=850238c253924f0fbed0bfe9f119207a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:49.630204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:49.768714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850238c253924f0fbed0bfe9f119207a', 'request_id': 'req-0016110e-f921-4508-8c70-f4562f7cd3d1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:49.781458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850238c253924f0fbed0bfe9f119207a', 'request_id': 'req-0016110e-f921-4508-8c70-f4562f7cd3d1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:49.790420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850238c253924f0fbed0bfe9f119207a', 'request_id': 'req-0016110e-f921-4508-8c70-f4562f7cd3d1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:49.810539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] The token cache is being invalidate because project 850238c253924f0fbed0bfe9f119207a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:49.810954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:49.811811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0016110e-f921-4508-8c70-f4562f7cd3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:49.814394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 986/1985] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:49 2022] DELETE /identity/v3/projects/850238c253924f0fbed0bfe9f119207a => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:49.828473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c69f4d-4720-4e8b-b5f3-13b0272d493d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:49.829653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c69f4d-4720-4e8b-b5f3-13b0272d493d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:49.832091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c69f4d-4720-4e8b-b5f3-13b0272d493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:49.905553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e1c69f4d-4720-4e8b-b5f3-13b0272d493d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:49.908976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e1c69f4d-4720-4e8b-b5f3-13b0272d493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:49.999919 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:50.107580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1000/1986] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:50.119147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0dd2f-50c8-4806-87ae-2fb4c8d12095 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:50.119680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0dd2f-50c8-4806-87ae-2fb4c8d12095 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:50.120315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0dd2f-50c8-4806-87ae-2fb4c8d12095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:50.200573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-92a0dd2f-50c8-4806-87ae-2fb4c8d12095 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:50.203197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92a0dd2f-50c8-4806-87ae-2fb4c8d12095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:50.240010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 987/1987] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:50.241270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c69f4d-4720-4e8b-b5f3-13b0272d493d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:50.283147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c69f4d-4720-4e8b-b5f3-13b0272d493d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:50.332747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef05244-882e-4aa6-84b4-e68dcf7fce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:50.334083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef05244-882e-4aa6-84b4-e68dcf7fce47 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:50.335218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef05244-882e-4aa6-84b4-e68dcf7fce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:50.335540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef05244-882e-4aa6-84b4-e68dcf7fce47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:50.338689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef05244-882e-4aa6-84b4-e68dcf7fce47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:50.340813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef05244-882e-4aa6-84b4-e68dcf7fce47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:50.342860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef05244-882e-4aa6-84b4-e68dcf7fce47 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:50.383889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0dd2f-50c8-4806-87ae-2fb4c8d12095 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:50.394529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1001/1988] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:33:50.395698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0dd2f-50c8-4806-87ae-2fb4c8d12095 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:50.414614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615fe6-e596-42b7-8db8-9e66fcd1e1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:50.415390 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615fe6-e596-42b7-8db8-9e66fcd1e1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:50.415753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615fe6-e596-42b7-8db8-9e66fcd1e1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:50.416111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615fe6-e596-42b7-8db8-9e66fcd1e1f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:50.417228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d615fe6-e596-42b7-8db8-9e66fcd1e1f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:50.420008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d615fe6-e596-42b7-8db8-9e66fcd1e1f4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:50.448108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:50.539292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 988/1989] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:50 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:50.543932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef05244-882e-4aa6-84b4-e68dcf7fce47 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:50.560548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef05244-882e-4aa6-84b4-e68dcf7fce47 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:50.675578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d691c-0cfe-494a-92bf-149e7d7650cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:50.676701 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d691c-0cfe-494a-92bf-149e7d7650cf admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:50.677177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d691c-0cfe-494a-92bf-149e7d7650cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:50.677640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d691c-0cfe-494a-92bf-149e7d7650cf admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:50.678876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d691c-0cfe-494a-92bf-149e7d7650cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:50.682706 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d691c-0cfe-494a-92bf-149e7d7650cf admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:50.716853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1002/1990] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:50 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:50.722590 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615fe6-e596-42b7-8db8-9e66fcd1e1f4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:50.741566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615fe6-e596-42b7-8db8-9e66fcd1e1f4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:50.749883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103dbf5-ebcb-4de8-929a-6f89bd6d2836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:50.751037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103dbf5-ebcb-4de8-929a-6f89bd6d2836 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:50.751519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103dbf5-ebcb-4de8-929a-6f89bd6d2836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:50.751994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103dbf5-ebcb-4de8-929a-6f89bd6d2836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:50.753190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103dbf5-ebcb-4de8-929a-6f89bd6d2836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:50.757855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103dbf5-ebcb-4de8-929a-6f89bd6d2836 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:50.786407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 989/1991] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:50.789003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d691c-0cfe-494a-92bf-149e7d7650cf admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:50.807006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d691c-0cfe-494a-92bf-149e7d7650cf admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:50.815327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2cab5-997a-4fdc-ac89-c925f019049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:50.817873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2cab5-997a-4fdc-ac89-c925f019049b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:50.817873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2cab5-997a-4fdc-ac89-c925f019049b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:50.817873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2cab5-997a-4fdc-ac89-c925f019049b admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:50.819278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2cab5-997a-4fdc-ac89-c925f019049b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:50.822260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2cab5-997a-4fdc-ac89-c925f019049b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:50.846322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1003/1992] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:50.851581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103dbf5-ebcb-4de8-929a-6f89bd6d2836 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:50.870041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103dbf5-ebcb-4de8-929a-6f89bd6d2836 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:50.875941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51642-7972-4e35-a23c-423ae2e2302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:50.876688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51642-7972-4e35-a23c-423ae2e2302d admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:50.877080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51642-7972-4e35-a23c-423ae2e2302d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:50.877379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51642-7972-4e35-a23c-423ae2e2302d admin admin] PATH_INFO: `/v3/projects/3e4067bb2fd14a369a33cf92055258d3/users/aee3a15e73ea47498195ecca096b1c4c/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:50.899618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a51642-7972-4e35-a23c-423ae2e2302d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4067bb2fd14a369a33cf92055258d3, user_id=aee3a15e73ea47498195ecca096b1c4c, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:50.906862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a51642-7972-4e35-a23c-423ae2e2302d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:50.933047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 990/1993] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:50 2022] PUT /identity/v3/projects/3e4067bb2fd14a369a33cf92055258d3/users/aee3a15e73ea47498195ecca096b1c4c/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:50.955271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d2f5e-64dd-43e9-9561-883288853c91 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:50.955807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d2f5e-64dd-43e9-9561-883288853c91 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:50.956188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d2f5e-64dd-43e9-9561-883288853c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:51.003817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3c4d2f5e-64dd-43e9-9561-883288853c91 None None] MFA Rules not processed for user `aee3a15e73ea47498195ecca096b1c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:51.006224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3c4d2f5e-64dd-43e9-9561-883288853c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:51.128978 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1004/1994] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:51.136281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51642-7972-4e35-a23c-423ae2e2302d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:51.272043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51642-7972-4e35-a23c-423ae2e2302d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:51.282438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee258c-d83a-4663-8382-3446152ec4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:51.283624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee258c-d83a-4663-8382-3446152ec4ca admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:51.284305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee258c-d83a-4663-8382-3446152ec4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:51.284839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee258c-d83a-4663-8382-3446152ec4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:51.287571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee258c-d83a-4663-8382-3446152ec4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:51.293349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee258c-d83a-4663-8382-3446152ec4ca admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:51.379611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732d21c-1021-4764-8b51-1b288b18b887 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:51.381550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732d21c-1021-4764-8b51-1b288b18b887 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:51.382329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732d21c-1021-4764-8b51-1b288b18b887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:51.416046 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 991/1995] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:51 2022] POST /identity/v3/projects => generated 387 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:51.421897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee258c-d83a-4663-8382-3446152ec4ca admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:51.479945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f732d21c-1021-4764-8b51-1b288b18b887 None None] MFA Rules not processed for user `3d824b7cad264484bde1071e4e6306ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:51.483343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f732d21c-1021-4764-8b51-1b288b18b887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:51.530000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:51.653302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee258c-d83a-4663-8382-3446152ec4ca admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:51.668539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1005/1996] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:51.673250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c5477-4e6e-413b-af3c-25d2c7e401aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:51.673966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5477-4e6e-413b-af3c-25d2c7e401aa admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:51.674424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5477-4e6e-413b-af3c-25d2c7e401aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:51.674622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5477-4e6e-413b-af3c-25d2c7e401aa admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:51.675415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c5477-4e6e-413b-af3c-25d2c7e401aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:51.677628 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c5477-4e6e-413b-af3c-25d2c7e401aa admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:51.725494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732d21c-1021-4764-8b51-1b288b18b887 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:51.727143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f732d21c-1021-4764-8b51-1b288b18b887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:51.742689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 992/1997] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:51 2022] POST /identity/v3/users => generated 294 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:51.745309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c5477-4e6e-413b-af3c-25d2c7e401aa admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:51.768916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c5477-4e6e-413b-af3c-25d2c7e401aa admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:51.782234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f358a-efb9-4195-9b07-05320f79bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:51.783018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f358a-efb9-4195-9b07-05320f79bb88 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:51.783316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f358a-efb9-4195-9b07-05320f79bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:51.783600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f358a-efb9-4195-9b07-05320f79bb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:51.787954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f358a-efb9-4195-9b07-05320f79bb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:51.790042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f358a-efb9-4195-9b07-05320f79bb88 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:51.837732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 993/1998] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:33:51.840059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f358a-efb9-4195-9b07-05320f79bb88 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:51.870542 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f358a-efb9-4195-9b07-05320f79bb88 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:51.884788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d400ec9-7b7b-4c20-a8ad-970e53805bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:51.885199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d400ec9-7b7b-4c20-a8ad-970e53805bab admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:51.886812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d400ec9-7b7b-4c20-a8ad-970e53805bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:51.887192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d400ec9-7b7b-4c20-a8ad-970e53805bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:51.888349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d400ec9-7b7b-4c20-a8ad-970e53805bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:51.895363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d400ec9-7b7b-4c20-a8ad-970e53805bab admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:51.897309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732d21c-1021-4764-8b51-1b288b18b887 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:51.910697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0306-a807-4c0a-b4a1-9dc8fa0217de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:51.911715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0306-a807-4c0a-b4a1-9dc8fa0217de service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:51.912104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0306-a807-4c0a-b4a1-9dc8fa0217de service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:51.913912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0306-a807-4c0a-b4a1-9dc8fa0217de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:51.953418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 994/1999] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:33:51.954643 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d400ec9-7b7b-4c20-a8ad-970e53805bab admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:51.960435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0306-a807-4c0a-b4a1-9dc8fa0217de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:51.966878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0306-a807-4c0a-b4a1-9dc8fa0217de service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:51.982956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d400ec9-7b7b-4c20-a8ad-970e53805bab admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:51.992690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1006/2000] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:51.995409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80ef2d-e92e-4e63-b115-142672d45b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:51.996662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80ef2d-e92e-4e63-b115-142672d45b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:51.997066 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80ef2d-e92e-4e63-b115-142672d45b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:51.997448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80ef2d-e92e-4e63-b115-142672d45b0a admin admin] PATH_INFO: `/v3/projects/310a1d7ce4ee4c27911ef9c85a764988/users/ac78f67555c54bf1a8774c694f8646ac/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:52.001571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:52.029439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80ef2d-e92e-4e63-b115-142672d45b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=310a1d7ce4ee4c27911ef9c85a764988, user_id=ac78f67555c54bf1a8774c694f8646ac, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:52.033028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80ef2d-e92e-4e63-b115-142672d45b0a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:52.053721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 995/2001] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:51 2022] PUT /identity/v3/projects/310a1d7ce4ee4c27911ef9c85a764988/users/ac78f67555c54bf1a8774c694f8646ac/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:52.081965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caea8f-b6b4-4cdf-9ae2-9f91115d1899 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:52.083913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caea8f-b6b4-4cdf-9ae2-9f91115d1899 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:52.084525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caea8f-b6b4-4cdf-9ae2-9f91115d1899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:52.132558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b1caea8f-b6b4-4cdf-9ae2-9f91115d1899 None None] MFA Rules not processed for user `ac78f67555c54bf1a8774c694f8646ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:52.136936 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b1caea8f-b6b4-4cdf-9ae2-9f91115d1899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:52.291571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1007/2002] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:52.299804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80ef2d-e92e-4e63-b115-142672d45b0a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:52.416435 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80ef2d-e92e-4e63-b115-142672d45b0a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:52.424564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5ce21-4627-4c34-bda3-abc54faf6263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:52.425955 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ce21-4627-4c34-bda3-abc54faf6263 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:52.426554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ce21-4627-4c34-bda3-abc54faf6263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:52.426961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ce21-4627-4c34-bda3-abc54faf6263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:52.429090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5ce21-4627-4c34-bda3-abc54faf6263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:52.437845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5ce21-4627-4c34-bda3-abc54faf6263 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:52.491815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 996/2003] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:52 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:33:52.499427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caea8f-b6b4-4cdf-9ae2-9f91115d1899 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:52.529547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caea8f-b6b4-4cdf-9ae2-9f91115d1899 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:52.652365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:52.700028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751f398-8a9f-4e77-ba96-762304205872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:52.701543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751f398-8a9f-4e77-ba96-762304205872 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:52.702130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751f398-8a9f-4e77-ba96-762304205872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:52.703879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751f398-8a9f-4e77-ba96-762304205872 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:52.704302 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751f398-8a9f-4e77-ba96-762304205872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:52.708744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751f398-8a9f-4e77-ba96-762304205872 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:52.791043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5ce21-4627-4c34-bda3-abc54faf6263 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:52.792120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1008/2004] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:52 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:52.828214 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5ce21-4627-4c34-bda3-abc54faf6263 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:52.848959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279943eb-23c4-40c7-8798-9f60dab356dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:52.849587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279943eb-23c4-40c7-8798-9f60dab356dc admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:52.849857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279943eb-23c4-40c7-8798-9f60dab356dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:52.850150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279943eb-23c4-40c7-8798-9f60dab356dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:52.850812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279943eb-23c4-40c7-8798-9f60dab356dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:52.852629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279943eb-23c4-40c7-8798-9f60dab356dc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:52.887138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 997/2005] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:52.896740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751f398-8a9f-4e77-ba96-762304205872 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:52.939659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751f398-8a9f-4e77-ba96-762304205872 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:52.949042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a51562-c5ec-48b6-b5a6-aa589f528de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:52.950320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a51562-c5ec-48b6-b5a6-aa589f528de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:52.950834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a51562-c5ec-48b6-b5a6-aa589f528de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:52.951511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a51562-c5ec-48b6-b5a6-aa589f528de4 admin admin] PATH_INFO: `/v3/projects/9ef560dae8784e56bf7e9fce87858767/users/1192e718efad45508f00e252323009ac/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:52.998310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a51562-c5ec-48b6-b5a6-aa589f528de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef560dae8784e56bf7e9fce87858767, user_id=1192e718efad45508f00e252323009ac, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:53.010102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a51562-c5ec-48b6-b5a6-aa589f528de4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:53.058364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1009/2006] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:52 2022] PUT /identity/v3/projects/9ef560dae8784e56bf7e9fce87858767/users/1192e718efad45508f00e252323009ac/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:53.066560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279943eb-23c4-40c7-8798-9f60dab356dc admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:53.096215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279943eb-23c4-40c7-8798-9f60dab356dc admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:53.305285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6dcdc-f4f8-43cb-b2c5-37f8c5729ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:53.305921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6dcdc-f4f8-43cb-b2c5-37f8c5729ced admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:53.306210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6dcdc-f4f8-43cb-b2c5-37f8c5729ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:53.306480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6dcdc-f4f8-43cb-b2c5-37f8c5729ced admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:53.311035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6dcdc-f4f8-43cb-b2c5-37f8c5729ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:53.314681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6dcdc-f4f8-43cb-b2c5-37f8c5729ced admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:53.344831 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 998/2007] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:53.352828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a51562-c5ec-48b6-b5a6-aa589f528de4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:53.412823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a51562-c5ec-48b6-b5a6-aa589f528de4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:53.451403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8dccc-dd5d-4611-b42a-cf1fe96ab8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:53.454811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8dccc-dd5d-4611-b42a-cf1fe96ab8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:53.454811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8dccc-dd5d-4611-b42a-cf1fe96ab8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:53.454811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8dccc-dd5d-4611-b42a-cf1fe96ab8e3 admin admin] PATH_INFO: `/v3/projects/9ef560dae8784e56bf7e9fce87858767/users/1192e718efad45508f00e252323009ac/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:53.467994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8dccc-dd5d-4611-b42a-cf1fe96ab8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef560dae8784e56bf7e9fce87858767, user_id=1192e718efad45508f00e252323009ac, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:53.477922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8dccc-dd5d-4611-b42a-cf1fe96ab8e3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:53.521620 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1010/2008] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:53 2022] PUT /identity/v3/projects/9ef560dae8784e56bf7e9fce87858767/users/1192e718efad45508f00e252323009ac/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:53.540071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39237-21ed-4b5a-9983-30c3619e81f6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:53.540333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39237-21ed-4b5a-9983-30c3619e81f6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:53.540739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39237-21ed-4b5a-9983-30c3619e81f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:53.562395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8dccc-dd5d-4611-b42a-cf1fe96ab8e3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:53.571922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5fa8dccc-dd5d-4611-b42a-cf1fe96ab8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:53.581212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-00e39237-21ed-4b5a-9983-30c3619e81f6 None None] MFA Rules not processed for user `1192e718efad45508f00e252323009ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:53.584010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-00e39237-21ed-4b5a-9983-30c3619e81f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:53.682096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:53.726008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 999/2009] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:53.744493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39237-21ed-4b5a-9983-30c3619e81f6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:53.749056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-00e39237-21ed-4b5a-9983-30c3619e81f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:53.759024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8dccc-dd5d-4611-b42a-cf1fe96ab8e3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:53.779217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:53.780766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:53.781308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:53.781810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] PATH_INFO: `/v3/users/3b57807a9b724b988e20176fdc6b5dc7` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:53.786012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b57807a9b724b988e20176fdc6b5dc7)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:53.791319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:53.870092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39237-21ed-4b5a-9983-30c3619e81f6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:53.881339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f62da-3dee-48f7-b84a-a3192521ee28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:53.884250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f62da-3dee-48f7-b84a-a3192521ee28 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:53.884735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f62da-3dee-48f7-b84a-a3192521ee28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:53.885774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f62da-3dee-48f7-b84a-a3192521ee28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:53.909073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f62da-3dee-48f7-b84a-a3192521ee28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:53.916128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f62da-3dee-48f7-b84a-a3192521ee28 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:53.945683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1000/2010] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:33:53.962414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b57807a9b724b988e20176fdc6b5dc7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:53.966123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b57807a9b724b988e20176fdc6b5dc7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:54.021504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8af524-21c2-43f5-8072-fba1c0d34079 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:54.021811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b57807a9b724b988e20176fdc6b5dc7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:54.022066 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8af524-21c2-43f5-8072-fba1c0d34079 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:54.022476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8af524-21c2-43f5-8072-fba1c0d34079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:54.064605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b57807a9b724b988e20176fdc6b5dc7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:54.086547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1d422709-f6e3-40f3-8fe2-361b1a1e2e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b57807a9b724b988e20176fdc6b5dc7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:54.101622 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1011/2011] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:53 2022] DELETE /identity/v3/users/3b57807a9b724b988e20176fdc6b5dc7 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:54.107252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3cdea-2275-4d12-a3c1-52beb0cc8dd1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:54.108081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3cdea-2275-4d12-a3c1-52beb0cc8dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:54.108757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3cdea-2275-4d12-a3c1-52beb0cc8dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:54.109927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9b8af524-21c2-43f5-8072-fba1c0d34079 None None] MFA Rules not processed for user `3d824b7cad264484bde1071e4e6306ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:54.116591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9b8af524-21c2-43f5-8072-fba1c0d34079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:54.151817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-eac3cdea-2275-4d12-a3c1-52beb0cc8dd1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:54.153636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eac3cdea-2275-4d12-a3c1-52beb0cc8dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:54.198346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:54.286464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1012/2012] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:54.314788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3cdea-2275-4d12-a3c1-52beb0cc8dd1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:54.317292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eac3cdea-2275-4d12-a3c1-52beb0cc8dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:54.341053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1001/2013] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:54.460453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3cdea-2275-4d12-a3c1-52beb0cc8dd1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:54.474178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5424f90-4f8a-4548-b7ef-ccca1abcc2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:54.475745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424f90-4f8a-4548-b7ef-ccca1abcc2cf service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:54.476044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424f90-4f8a-4548-b7ef-ccca1abcc2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:54.476491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424f90-4f8a-4548-b7ef-ccca1abcc2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:54.498063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5424f90-4f8a-4548-b7ef-ccca1abcc2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:54.501155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5424f90-4f8a-4548-b7ef-ccca1abcc2cf service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:54.531917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1013/2014] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:33:54.564166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8af524-21c2-43f5-8072-fba1c0d34079 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:54.565814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9b8af524-21c2-43f5-8072-fba1c0d34079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:54.585516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8af524-21c2-43f5-8072-fba1c0d34079 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:54.591569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:54.592241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:54.592522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:54.592798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] PATH_INFO: `/v3/users/030573ae35ba4ed2b0f8b94744ea09a7` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:54.594266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] RBAC: Authorizing `identity:delete_user(user_id=030573ae35ba4ed2b0f8b94744ea09a7)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:54.599016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:54.681648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030573ae35ba4ed2b0f8b94744ea09a7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:54.682475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030573ae35ba4ed2b0f8b94744ea09a7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:54.683157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030573ae35ba4ed2b0f8b94744ea09a7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:54.715533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030573ae35ba4ed2b0f8b94744ea09a7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:54.732929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030573ae35ba4ed2b0f8b94744ea09a7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:54.751035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:54.772325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1002/2015] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:54 2022] DELETE /identity/v3/users/030573ae35ba4ed2b0f8b94744ea09a7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:54.775758 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7c884-c439-4745-a65d-0530c3e088d6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:54.776120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7c884-c439-4745-a65d-0530c3e088d6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:54.776576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7c884-c439-4745-a65d-0530c3e088d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:54.855944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9ec7c884-c439-4745-a65d-0530c3e088d6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:54.858770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9ec7c884-c439-4745-a65d-0530c3e088d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:55.161165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1014/2016] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:55.254147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:55.259589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:55.365413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7c884-c439-4745-a65d-0530c3e088d6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:55.367667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9ec7c884-c439-4745-a65d-0530c3e088d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:55.390907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370dda-59c0-42f6-8020-de8a3f3e806c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:55.395972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74067e85-804a-4fc9-b24f-bae63d2d6f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:55.396787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74067e85-804a-4fc9-b24f-bae63d2d6f42 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:55.397471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74067e85-804a-4fc9-b24f-bae63d2d6f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:55.398362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74067e85-804a-4fc9-b24f-bae63d2d6f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:55.414543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74067e85-804a-4fc9-b24f-bae63d2d6f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:55.417312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74067e85-804a-4fc9-b24f-bae63d2d6f42 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:55.435847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1003/2017] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:55.443697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7c884-c439-4745-a65d-0530c3e088d6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:55.448201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:55.449010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:55.449301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:55.449686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:55.452062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:55.494341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:55.596404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:55.598785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:55.618851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1015/2018] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:33:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:33:57.519882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74067e85-804a-4fc9-b24f-bae63d2d6f42 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:57.522362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-74067e85-804a-4fc9-b24f-bae63d2d6f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:57.570896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74067e85-804a-4fc9-b24f-bae63d2d6f42 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:57.610251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:57.617706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:57.618259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:57.618795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] PATH_INFO: `/v3/projects/698ae0258a0f4fa2b31325bc1083a1a3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:57.630355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698ae0258a0f4fa2b31325bc1083a1a3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:57.638745 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:57.710183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:57.712381 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:57.755035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a71e8-b346-4c2b-8429-df1d8e1768a8 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:57.780227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698ae0258a0f4fa2b31325bc1083a1a3', 'request_id': 'req-7fd73ce3-9af9-48f1-89cf-e844bc520119'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:57.838368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698ae0258a0f4fa2b31325bc1083a1a3', 'request_id': 'req-7fd73ce3-9af9-48f1-89cf-e844bc520119'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:57.872550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698ae0258a0f4fa2b31325bc1083a1a3', 'request_id': 'req-7fd73ce3-9af9-48f1-89cf-e844bc520119'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:57.906110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] The token cache is being invalidate because project 698ae0258a0f4fa2b31325bc1083a1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:57.906453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:57.907313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7fd73ce3-9af9-48f1-89cf-e844bc520119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:57.909859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1004/2019] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:57 2022] DELETE /identity/v3/projects/698ae0258a0f4fa2b31325bc1083a1a3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:33:57.917297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ba9fc-1863-488d-87a4-3fa551adbc82 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:57.917568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ba9fc-1863-488d-87a4-3fa551adbc82 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:57.917881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ba9fc-1863-488d-87a4-3fa551adbc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:57.933624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:57.935374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:57.936799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:57.938015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] PATH_INFO: `/v3/projects/5ad2074fb51949698df7ae173e9d2e50` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:57.942395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad2074fb51949698df7ae173e9d2e50)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:57.947630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:57.960376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fb7ba9fc-1863-488d-87a4-3fa551adbc82 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:57.961750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fb7ba9fc-1863-488d-87a4-3fa551adbc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:57.987057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1005/2020] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:33:57.999322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ab8b-3afe-4b3d-91af-34387b4af576 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:57.999589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ab8b-3afe-4b3d-91af-34387b4af576 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:58.000236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41ab8b-3afe-4b3d-91af-34387b4af576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:58.051387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9d41ab8b-3afe-4b3d-91af-34387b4af576 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:58.054264 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9d41ab8b-3afe-4b3d-91af-34387b4af576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:58.072852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad2074fb51949698df7ae173e9d2e50', 'request_id': 'req-fa1686fe-9fbf-47fc-918f-d078d0ac2866'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.089771 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad2074fb51949698df7ae173e9d2e50', 'request_id': 'req-fa1686fe-9fbf-47fc-918f-d078d0ac2866'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.120489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad2074fb51949698df7ae173e9d2e50', 'request_id': 'req-fa1686fe-9fbf-47fc-918f-d078d0ac2866'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.160385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] The token cache is being invalidate because project 5ad2074fb51949698df7ae173e9d2e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:33:58.161414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.163043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.167803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1016/2021] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:57 2022] DELETE /identity/v3/projects/5ad2074fb51949698df7ae173e9d2e50 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:58.174098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:58.177609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:58.290881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1006/2022] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:58.295570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41ab8b-3afe-4b3d-91af-34387b4af576 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:58.305333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:58.318480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41ab8b-3afe-4b3d-91af-34387b4af576 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:58.334697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1686fe-9fbf-47fc-918f-d078d0ac2866 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:58.337662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7c9ef-8c78-4f56-a447-90107daa71b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:58.339091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7c9ef-8c78-4f56-a447-90107daa71b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:58.339693 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7c9ef-8c78-4f56-a447-90107daa71b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:58.340763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7c9ef-8c78-4f56-a447-90107daa71b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:58.341828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7c9ef-8c78-4f56-a447-90107daa71b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:33:58.342410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7c9ef-8c78-4f56-a447-90107daa71b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:58.345600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7c9ef-8c78-4f56-a447-90107daa71b1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:58.349546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:58.351773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:58.352779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:58.352779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] PATH_INFO: `/v3/users/b81e8347b290417b85b6c1435f852528` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:58.354246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81e8347b290417b85b6c1435f852528)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:58.356617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:58.382602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1007/2023] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:33:58.384202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7c9ef-8c78-4f56-a447-90107daa71b1 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:58.395287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:58.401043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7c9ef-8c78-4f56-a447-90107daa71b1 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:58.415614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d60ab7-31ba-4386-8bcc-8a6de0b42b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:58.418469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d60ab7-31ba-4386-8bcc-8a6de0b42b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:58.419051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d60ab7-31ba-4386-8bcc-8a6de0b42b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:58.420283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d60ab7-31ba-4386-8bcc-8a6de0b42b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:58.421697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d60ab7-31ba-4386-8bcc-8a6de0b42b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:58.427305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d60ab7-31ba-4386-8bcc-8a6de0b42b01 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:58.492127 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81e8347b290417b85b6c1435f852528'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.492127 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81e8347b290417b85b6c1435f852528'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.510692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1008/2024] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:58 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:58.515819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d60ab7-31ba-4386-8bcc-8a6de0b42b01 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:58.524260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b0d60ab7-31ba-4386-8bcc-8a6de0b42b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:58.539863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81e8347b290417b85b6c1435f852528'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.582371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81e8347b290417b85b6c1435f852528'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.643451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81e8347b290417b85b6c1435f852528'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:33:58.664506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1017/2025] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:33:58 2022] DELETE /identity/v3/users/b81e8347b290417b85b6c1435f852528 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:58.677152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d60ab7-31ba-4386-8bcc-8a6de0b42b01 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:58.827620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eace6a-c242-4656-89f5-27f3b89057e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:58.831382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eace6a-c242-4656-89f5-27f3b89057e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:58.833525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eace6a-c242-4656-89f5-27f3b89057e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:58.834140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eace6a-c242-4656-89f5-27f3b89057e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:58.836224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eace6a-c242-4656-89f5-27f3b89057e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:58.865787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eace6a-c242-4656-89f5-27f3b89057e3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:58.994148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1009/2026] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:33:58 2022] POST /identity/v3/users => generated 293 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:33:58.999276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:59.042243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926383b5-16e7-4eb3-b051-9c0d5990ec8e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:59.054214 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28d8a6-dd7b-43da-af73-ac7636b580ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:59.055473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28d8a6-dd7b-43da-af73-ac7636b580ee admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:59.056760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28d8a6-dd7b-43da-af73-ac7636b580ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:59.057393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28d8a6-dd7b-43da-af73-ac7636b580ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:59.058836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28d8a6-dd7b-43da-af73-ac7636b580ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:59.063163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28d8a6-dd7b-43da-af73-ac7636b580ee admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:59.096823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1018/2027] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:33:59.100959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eace6a-c242-4656-89f5-27f3b89057e3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:59.167825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eace6a-c242-4656-89f5-27f3b89057e3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:59.191853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a835f3-d948-424f-817b-f4cb32d0cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:59.192523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a835f3-d948-424f-817b-f4cb32d0cdfb admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:59.192808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a835f3-d948-424f-817b-f4cb32d0cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:59.193116 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a835f3-d948-424f-817b-f4cb32d0cdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:59.193836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a835f3-d948-424f-817b-f4cb32d0cdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:59.195675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a835f3-d948-424f-817b-f4cb32d0cdfb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:59.228489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1010/2028] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:33:59.233382 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28d8a6-dd7b-43da-af73-ac7636b580ee admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:59.263451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28d8a6-dd7b-43da-af73-ac7636b580ee admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:59.287498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1090-9c13-4ea1-ad56-14ce9fcf9164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:59.288725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1090-9c13-4ea1-ad56-14ce9fcf9164 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:59.289413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1090-9c13-4ea1-ad56-14ce9fcf9164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:59.291606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1090-9c13-4ea1-ad56-14ce9fcf9164 admin admin] PATH_INFO: `/v3/projects/e9a5fd3a934649c18e4026a82632f9fe/users/71747f16927645ae9506b758039dcba8/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:59.323010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa1090-9c13-4ea1-ad56-14ce9fcf9164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a5fd3a934649c18e4026a82632f9fe, user_id=71747f16927645ae9506b758039dcba8, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:59.326082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa1090-9c13-4ea1-ad56-14ce9fcf9164 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:59.362918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1019/2029] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:33:59 2022] PUT /identity/v3/projects/e9a5fd3a934649c18e4026a82632f9fe/users/71747f16927645ae9506b758039dcba8/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:33:59.378150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300493f-48ca-442d-83bd-f23216c7ca25 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:59.378997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300493f-48ca-442d-83bd-f23216c7ca25 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:59.379830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300493f-48ca-442d-83bd-f23216c7ca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:59.492508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4300493f-48ca-442d-83bd-f23216c7ca25 None None] MFA Rules not processed for user `71747f16927645ae9506b758039dcba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:33:59.494875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4300493f-48ca-442d-83bd-f23216c7ca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:59.609726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:59.631054 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1011/2030] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:33:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:33:59.648881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1090-9c13-4ea1-ad56-14ce9fcf9164 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:59.695306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300493f-48ca-442d-83bd-f23216c7ca25 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:33:59.698682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4300493f-48ca-442d-83bd-f23216c7ca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:33:59.908198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1090-9c13-4ea1-ad56-14ce9fcf9164 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:59.919061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b70f-72e3-42a2-9ae7-9449ccb48f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:59.921154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b70f-72e3-42a2-9ae7-9449ccb48f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:59.922463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b70f-72e3-42a2-9ae7-9449ccb48f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:59.923337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b70f-72e3-42a2-9ae7-9449ccb48f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:33:59.925064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460b70f-72e3-42a2-9ae7-9449ccb48f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:33:59.931134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460b70f-72e3-42a2-9ae7-9449ccb48f18 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:33:59.973444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300493f-48ca-442d-83bd-f23216c7ca25 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:33:59.997543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:33:59.998718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:33:59.999244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:33:59.999752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] PATH_INFO: `/v3/projects/4b00185215da4144ae262506d663753b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:00.004859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b00185215da4144ae262506d663753b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:00.011288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:00.040790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1020/2031] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:33:59 2022] POST /identity/v3/projects => generated 383 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:00.042552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b70f-72e3-42a2-9ae7-9449ccb48f18 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:00.219467 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:00.266932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b00185215da4144ae262506d663753b', 'request_id': 'req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:00.306209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b00185215da4144ae262506d663753b', 'request_id': 'req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:00.337243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b00185215da4144ae262506d663753b', 'request_id': 'req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:00.390608 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] The token cache is being invalidate because project 4b00185215da4144ae262506d663753b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:00.391390 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:00.396935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ef5d2142-ab2d-4a25-9f18-6fdfb95c003c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:00.411106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1012/2032] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:33:59 2022] DELETE /identity/v3/projects/4b00185215da4144ae262506d663753b => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:00.414265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48959897-58f5-485e-ba67-b381db8f8115 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:00.414573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48959897-58f5-485e-ba67-b381db8f8115 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:00.415074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48959897-58f5-485e-ba67-b381db8f8115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:00.433521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b70f-72e3-42a2-9ae7-9449ccb48f18 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:00.523732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-48959897-58f5-485e-ba67-b381db8f8115 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:00.528534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-48959897-58f5-485e-ba67-b381db8f8115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:00.736182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82ccf2-f8e5-4bb4-9fbb-cf538f9cbbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:00.736182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82ccf2-f8e5-4bb4-9fbb-cf538f9cbbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:00.736182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82ccf2-f8e5-4bb4-9fbb-cf538f9cbbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:00.736182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82ccf2-f8e5-4bb4-9fbb-cf538f9cbbb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:00.737845 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82ccf2-f8e5-4bb4-9fbb-cf538f9cbbb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:00.742634 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82ccf2-f8e5-4bb4-9fbb-cf538f9cbbb6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:00.786144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1021/2033] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:00 2022] POST /identity/v3/users => generated 292 bytes in 744 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:00.791572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82ccf2-f8e5-4bb4-9fbb-cf538f9cbbb6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:00.794835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1013/2034] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:34:00.804699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5c82ccf2-f8e5-4bb4-9fbb-cf538f9cbbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:00.808535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143da891-7e4a-48c0-8a87-4a8b2119be54 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:00.813382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143da891-7e4a-48c0-8a87-4a8b2119be54 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:00.814552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143da891-7e4a-48c0-8a87-4a8b2119be54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:00.819189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82ccf2-f8e5-4bb4-9fbb-cf538f9cbbb6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:00.824720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f22b64-067a-41a4-8e4c-79ef4c5ca872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:00.825404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f22b64-067a-41a4-8e4c-79ef4c5ca872 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:00.825682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f22b64-067a-41a4-8e4c-79ef4c5ca872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:00.826066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f22b64-067a-41a4-8e4c-79ef4c5ca872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:00.826684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f22b64-067a-41a4-8e4c-79ef4c5ca872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:00.828540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f22b64-067a-41a4-8e4c-79ef4c5ca872 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:00.842599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1022/2035] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:00.848269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f22b64-067a-41a4-8e4c-79ef4c5ca872 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:00.863086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f22b64-067a-41a4-8e4c-79ef4c5ca872 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:00.875842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d610b-f0fe-46de-9ab5-beaa5f6a9f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:00.877062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d610b-f0fe-46de-9ab5-beaa5f6a9f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:00.877525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d610b-f0fe-46de-9ab5-beaa5f6a9f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:00.878226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d610b-f0fe-46de-9ab5-beaa5f6a9f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:00.879400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d610b-f0fe-46de-9ab5-beaa5f6a9f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:00.881417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d610b-f0fe-46de-9ab5-beaa5f6a9f83 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:00.896714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1023/2036] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:00.903137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d610b-f0fe-46de-9ab5-beaa5f6a9f83 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:00.915484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-143da891-7e4a-48c0-8a87-4a8b2119be54 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:00.917775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-143da891-7e4a-48c0-8a87-4a8b2119be54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:00.930149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d610b-f0fe-46de-9ab5-beaa5f6a9f83 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:00.946307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1014/2037] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:00.947427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143da891-7e4a-48c0-8a87-4a8b2119be54 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:00.954100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f74650-1835-4297-ab4b-41160bb00248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:00.954878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f74650-1835-4297-ab4b-41160bb00248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:00.955140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f74650-1835-4297-ab4b-41160bb00248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:00.955485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f74650-1835-4297-ab4b-41160bb00248 admin admin] PATH_INFO: `/v3/projects/f7a6300beb824430abe7345262b369b1/users/7dd537f8991a48dcb27faf12471ef7a8/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:00.973538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143da891-7e4a-48c0-8a87-4a8b2119be54 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:00.988141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea023e-5db6-44fe-b974-3a1896ca6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:00.988842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea023e-5db6-44fe-b974-3a1896ca6efe admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:00.989139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea023e-5db6-44fe-b974-3a1896ca6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:00.989446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea023e-5db6-44fe-b974-3a1896ca6efe admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:00.990123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea023e-5db6-44fe-b974-3a1896ca6efe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:34:00.995403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea023e-5db6-44fe-b974-3a1896ca6efe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:00.997874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea023e-5db6-44fe-b974-3a1896ca6efe admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:01.001635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f74650-1835-4297-ab4b-41160bb00248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a6300beb824430abe7345262b369b1, user_id=7dd537f8991a48dcb27faf12471ef7a8, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:01.006181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f74650-1835-4297-ab4b-41160bb00248 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:01.038219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1015/2038] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:34:01.042583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1024/2039] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:00 2022] PUT /identity/v3/projects/f7a6300beb824430abe7345262b369b1/users/7dd537f8991a48dcb27faf12471ef7a8/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:01.043835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea023e-5db6-44fe-b974-3a1896ca6efe admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:01.056470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebff57e-7857-4008-bd6c-d51e273c878c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:01.057111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebff57e-7857-4008-bd6c-d51e273c878c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:01.057111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebff57e-7857-4008-bd6c-d51e273c878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:01.076723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea023e-5db6-44fe-b974-3a1896ca6efe admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:01.094592 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:01.126981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-eebff57e-7857-4008-bd6c-d51e273c878c None None] MFA Rules not processed for user `7dd537f8991a48dcb27faf12471ef7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:01.133804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eebff57e-7857-4008-bd6c-d51e273c878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:01.253896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d9d38-a6e0-45b0-ae22-1152dc364164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:01.254776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d9d38-a6e0-45b0-ae22-1152dc364164 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:01.255165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d9d38-a6e0-45b0-ae22-1152dc364164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:01.255447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d9d38-a6e0-45b0-ae22-1152dc364164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:01.256157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d9d38-a6e0-45b0-ae22-1152dc364164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:01.258375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d9d38-a6e0-45b0-ae22-1152dc364164 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:01.325253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1025/2040] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:01.327373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebff57e-7857-4008-bd6c-d51e273c878c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:01.329502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1016/2041] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:01 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:01.337443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:01.340772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d9d38-a6e0-45b0-ae22-1152dc364164 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:01.371345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebff57e-7857-4008-bd6c-d51e273c878c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:01.531765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d9d38-a6e0-45b0-ae22-1152dc364164 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:01.561589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97caca-6d53-4737-afcf-5965154e5c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:01.563159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97caca-6d53-4737-afcf-5965154e5c8b admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:01.563657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97caca-6d53-4737-afcf-5965154e5c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:01.564102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97caca-6d53-4737-afcf-5965154e5c8b admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:01.566058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97caca-6d53-4737-afcf-5965154e5c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:01.588071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97caca-6d53-4737-afcf-5965154e5c8b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:01.651943 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1017/2042] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:01 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:01.661730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97caca-6d53-4737-afcf-5965154e5c8b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:01.682518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340fa29-cdc3-45c4-b08c-a64fdb27b094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:01.683387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fa29-cdc3-45c4-b08c-a64fdb27b094 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:01.685033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fa29-cdc3-45c4-b08c-a64fdb27b094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:01.688116 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97caca-6d53-4737-afcf-5965154e5c8b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:01.695342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb15b8-9b1b-44bd-b3a5-2e444c1f9ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:01.696371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb15b8-9b1b-44bd-b3a5-2e444c1f9ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:01.696923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb15b8-9b1b-44bd-b3a5-2e444c1f9ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:01.697455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb15b8-9b1b-44bd-b3a5-2e444c1f9ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:01.698872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb15b8-9b1b-44bd-b3a5-2e444c1f9ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:01.703097 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb15b8-9b1b-44bd-b3a5-2e444c1f9ec3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:01.703751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fa29-cdc3-45c4-b08c-a64fdb27b094 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:01.707206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340fa29-cdc3-45c4-b08c-a64fdb27b094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:01.717270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340fa29-cdc3-45c4-b08c-a64fdb27b094 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:01.752639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1018/2043] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:01.754706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb15b8-9b1b-44bd-b3a5-2e444c1f9ec3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:01.779980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb15b8-9b1b-44bd-b3a5-2e444c1f9ec3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:01.800303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2356c76-7d34-4988-88a1-13758970ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:01.803036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356c76-7d34-4988-88a1-13758970ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:01.803822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356c76-7d34-4988-88a1-13758970ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:01.804525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356c76-7d34-4988-88a1-13758970ebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:01.806245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2356c76-7d34-4988-88a1-13758970ebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:01.820837 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2356c76-7d34-4988-88a1-13758970ebd2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:01.857366 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1019/2044] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:01.859552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2356c76-7d34-4988-88a1-13758970ebd2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:01.896807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1026/2045] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:01 2022] POST /identity/v3/projects => generated 385 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:01.898462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340fa29-cdc3-45c4-b08c-a64fdb27b094 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:01.900073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2356c76-7d34-4988-88a1-13758970ebd2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:02.035107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340fa29-cdc3-45c4-b08c-a64fdb27b094 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:02.043716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740b4f3-9796-495a-9218-31e385730e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:02.044647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b4f3-9796-495a-9218-31e385730e20 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:02.044967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b4f3-9796-495a-9218-31e385730e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:02.045315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b4f3-9796-495a-9218-31e385730e20 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:02.046959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740b4f3-9796-495a-9218-31e385730e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:02.049420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740b4f3-9796-495a-9218-31e385730e20 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:02.085129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1027/2046] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:01 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:02.086504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740b4f3-9796-495a-9218-31e385730e20 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:02.091521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4740b4f3-9796-495a-9218-31e385730e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:02.154120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df8fff-3acb-42c7-8341-98a534496644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:02.155417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df8fff-3acb-42c7-8341-98a534496644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:02.155913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df8fff-3acb-42c7-8341-98a534496644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:02.156401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df8fff-3acb-42c7-8341-98a534496644 admin admin] PATH_INFO: `/v3/projects/5e2f4cfc89594ad9a178a8a0334eb14d/users/7706b0aa5b0c433d8a33a36f4b8a8c40/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:02.175999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:02.240192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df8fff-3acb-42c7-8341-98a534496644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2f4cfc89594ad9a178a8a0334eb14d, user_id=7706b0aa5b0c433d8a33a36f4b8a8c40, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:02.263333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df8fff-3acb-42c7-8341-98a534496644 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:02.285528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740b4f3-9796-495a-9218-31e385730e20 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:02.309959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18591d35-4b29-4dd7-8fc7-c4eea42721c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:02.313686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591d35-4b29-4dd7-8fc7-c4eea42721c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:02.314186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591d35-4b29-4dd7-8fc7-c4eea42721c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:02.317442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591d35-4b29-4dd7-8fc7-c4eea42721c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:02.327523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-18591d35-4b29-4dd7-8fc7-c4eea42721c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:02.330093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1020/2047] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:01 2022] PUT /identity/v3/projects/5e2f4cfc89594ad9a178a8a0334eb14d/users/7706b0aa5b0c433d8a33a36f4b8a8c40/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:02.347101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df8fff-3acb-42c7-8341-98a534496644 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:02.420203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:02.498178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18591d35-4b29-4dd7-8fc7-c4eea42721c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:02.500049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18591d35-4b29-4dd7-8fc7-c4eea42721c1 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:02.517586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1028/2048] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:02.530854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e16d45-6c63-4b04-8bb0-0f773eaf0364 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:02.531326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e16d45-6c63-4b04-8bb0-0f773eaf0364 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:02.531754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e16d45-6c63-4b04-8bb0-0f773eaf0364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:02.555901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df8fff-3acb-42c7-8341-98a534496644 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:02.570771 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94447d-2bb0-424d-b4b1-94ddcda67163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:02.572553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94447d-2bb0-424d-b4b1-94ddcda67163 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:02.573382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94447d-2bb0-424d-b4b1-94ddcda67163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:02.574547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94447d-2bb0-424d-b4b1-94ddcda67163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:02.575727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94447d-2bb0-424d-b4b1-94ddcda67163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:02.579750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94447d-2bb0-424d-b4b1-94ddcda67163 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:02.615390 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1021/2049] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:02.616591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-68e16d45-6c63-4b04-8bb0-0f773eaf0364 None None] MFA Rules not processed for user `7706b0aa5b0c433d8a33a36f4b8a8c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:02.617709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94447d-2bb0-424d-b4b1-94ddcda67163 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:02.618813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-68e16d45-6c63-4b04-8bb0-0f773eaf0364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:02.643985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94447d-2bb0-424d-b4b1-94ddcda67163 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:02.663002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b48592-d53d-4c4d-b481-f68ab6f22f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:02.663706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b48592-d53d-4c4d-b481-f68ab6f22f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:02.665852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b48592-d53d-4c4d-b481-f68ab6f22f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:02.666224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b48592-d53d-4c4d-b481-f68ab6f22f26 admin admin] PATH_INFO: `/v3/projects/6d79f6be1f9347ad9cc62b791f484738/users/2c2780e683d94e76a57d1970a14aa41f/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:02.700457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b48592-d53d-4c4d-b481-f68ab6f22f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d79f6be1f9347ad9cc62b791f484738, user_id=2c2780e683d94e76a57d1970a14aa41f, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:02.704076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b48592-d53d-4c4d-b481-f68ab6f22f26 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:02.729093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1022/2050] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:02 2022] PUT /identity/v3/projects/6d79f6be1f9347ad9cc62b791f484738/users/2c2780e683d94e76a57d1970a14aa41f/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:02.737576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b48592-d53d-4c4d-b481-f68ab6f22f26 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:02.792626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1029/2051] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:02.798364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e16d45-6c63-4b04-8bb0-0f773eaf0364 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:02.831455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e16d45-6c63-4b04-8bb0-0f773eaf0364 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:02.890492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b48592-d53d-4c4d-b481-f68ab6f22f26 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:02.914844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567665c-8d18-496d-a748-d1c2561f683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:02.916278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567665c-8d18-496d-a748-d1c2561f683e admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:02.916278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567665c-8d18-496d-a748-d1c2561f683e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:02.916278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567665c-8d18-496d-a748-d1c2561f683e admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:02.916947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567665c-8d18-496d-a748-d1c2561f683e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:02.919012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567665c-8d18-496d-a748-d1c2561f683e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:02.967473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1023/2052] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:02.969078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567665c-8d18-496d-a748-d1c2561f683e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:02.990411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567665c-8d18-496d-a748-d1c2561f683e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:03.010509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fe1d8-8603-4921-afa1-187df0a5a398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:03.017709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fe1d8-8603-4921-afa1-187df0a5a398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:03.017709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fe1d8-8603-4921-afa1-187df0a5a398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:03.017709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fe1d8-8603-4921-afa1-187df0a5a398 admin admin] PATH_INFO: `/v3/projects/6d79f6be1f9347ad9cc62b791f484738/users/2c2780e683d94e76a57d1970a14aa41f/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:03.024485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fe1d8-8603-4921-afa1-187df0a5a398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d79f6be1f9347ad9cc62b791f484738, user_id=2c2780e683d94e76a57d1970a14aa41f, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:03.036722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fe1d8-8603-4921-afa1-187df0a5a398 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:03.041120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829aea-61e5-4a80-9bee-1e33b1365fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:03.045292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829aea-61e5-4a80-9bee-1e33b1365fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:03.046309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829aea-61e5-4a80-9bee-1e33b1365fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:03.046309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829aea-61e5-4a80-9bee-1e33b1365fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:03.049775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc829aea-61e5-4a80-9bee-1e33b1365fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:03.057709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc829aea-61e5-4a80-9bee-1e33b1365fb9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:03.098775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1024/2053] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:02 2022] PUT /identity/v3/projects/6d79f6be1f9347ad9cc62b791f484738/users/2c2780e683d94e76a57d1970a14aa41f/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:03.113085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff7c71-ceb1-423e-8990-efc801baee7c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:03.113763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff7c71-ceb1-423e-8990-efc801baee7c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:03.114341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff7c71-ceb1-423e-8990-efc801baee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:03.178259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1030/2054] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:02 2022] POST /identity/v3/projects => generated 383 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:03.184404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829aea-61e5-4a80-9bee-1e33b1365fb9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:03.227604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-75ff7c71-ceb1-423e-8990-efc801baee7c None None] MFA Rules not processed for user `2c2780e683d94e76a57d1970a14aa41f`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:03.229380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-75ff7c71-ceb1-423e-8990-efc801baee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:03.289683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:03.297828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:03.374506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829aea-61e5-4a80-9bee-1e33b1365fb9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:03.404270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260de62-b386-40c3-9454-414a86330c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:03.405305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260de62-b386-40c3-9454-414a86330c99 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:03.405693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260de62-b386-40c3-9454-414a86330c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:03.405970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260de62-b386-40c3-9454-414a86330c99 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:03.409979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260de62-b386-40c3-9454-414a86330c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:03.420182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260de62-b386-40c3-9454-414a86330c99 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:03.450715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1025/2055] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:03.474089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff7c71-ceb1-423e-8990-efc801baee7c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:03.478525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-75ff7c71-ceb1-423e-8990-efc801baee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:03.504724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1031/2056] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:03 2022] POST /identity/v3/users => generated 298 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:03.511148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260de62-b386-40c3-9454-414a86330c99 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:03.546336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260de62-b386-40c3-9454-414a86330c99 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:03.570401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d68dc-532f-42fe-b5b1-28d99047f7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:03.575183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d68dc-532f-42fe-b5b1-28d99047f7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:03.576763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d68dc-532f-42fe-b5b1-28d99047f7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:03.577506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d68dc-532f-42fe-b5b1-28d99047f7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:03.582746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d68dc-532f-42fe-b5b1-28d99047f7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:03.592943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d68dc-532f-42fe-b5b1-28d99047f7a6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:03.651154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1032/2057] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:03.653536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff7c71-ceb1-423e-8990-efc801baee7c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:03.657627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d68dc-532f-42fe-b5b1-28d99047f7a6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:03.661971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d9cbf-b077-4818-b397-68a7156d590b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:03.663060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d9cbf-b077-4818-b397-68a7156d590b service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:03.663389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d9cbf-b077-4818-b397-68a7156d590b service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:03.663710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d9cbf-b077-4818-b397-68a7156d590b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:03.666634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b11d9cbf-b077-4818-b397-68a7156d590b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:03.697517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d68dc-532f-42fe-b5b1-28d99047f7a6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:03.714385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961cf83-50f4-41e5-a23c-e45ad52324b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:03.715291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961cf83-50f4-41e5-a23c-e45ad52324b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:03.716556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961cf83-50f4-41e5-a23c-e45ad52324b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:03.716937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961cf83-50f4-41e5-a23c-e45ad52324b9 admin admin] PATH_INFO: `/v3/projects/509399e0bb1c448d89bfc0e13a1d5613/users/78936ce51fde43c6a3db393b591d29f1/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:03.759253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961cf83-50f4-41e5-a23c-e45ad52324b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509399e0bb1c448d89bfc0e13a1d5613, user_id=78936ce51fde43c6a3db393b591d29f1, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:03.766197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961cf83-50f4-41e5-a23c-e45ad52324b9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:03.801418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1033/2058] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:03 2022] PUT /identity/v3/projects/509399e0bb1c448d89bfc0e13a1d5613/users/78936ce51fde43c6a3db393b591d29f1/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:03.808960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961cf83-50f4-41e5-a23c-e45ad52324b9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:03.868488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d9cbf-b077-4818-b397-68a7156d590b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:03.879579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d9cbf-b077-4818-b397-68a7156d590b service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:03.935047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1026/2059] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:34:04.014426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961cf83-50f4-41e5-a23c-e45ad52324b9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:04.025108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff6c5d-f3ff-4e19-9572-1404727c889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:04.029653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff6c5d-f3ff-4e19-9572-1404727c889a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:04.029653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff6c5d-f3ff-4e19-9572-1404727c889a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:04.029653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff6c5d-f3ff-4e19-9572-1404727c889a admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:04.031500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff6c5d-f3ff-4e19-9572-1404727c889a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:04.034925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff6c5d-f3ff-4e19-9572-1404727c889a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:04.086770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1034/2060] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:04.088514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d9cbf-b077-4818-b397-68a7156d590b service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:04.148932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d9cbf-b077-4818-b397-68a7156d590b service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:04.158507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bffde4-2186-4eac-b7fd-2691b0e063b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:04.159395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bffde4-2186-4eac-b7fd-2691b0e063b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:04.159782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bffde4-2186-4eac-b7fd-2691b0e063b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:04.160241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bffde4-2186-4eac-b7fd-2691b0e063b8 admin admin] PATH_INFO: `/v3/projects/509399e0bb1c448d89bfc0e13a1d5613/users/78936ce51fde43c6a3db393b591d29f1/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:04.164025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bffde4-2186-4eac-b7fd-2691b0e063b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509399e0bb1c448d89bfc0e13a1d5613, user_id=78936ce51fde43c6a3db393b591d29f1, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:04.169657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bffde4-2186-4eac-b7fd-2691b0e063b8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:04.193206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1027/2061] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:04 2022] PUT /identity/v3/projects/509399e0bb1c448d89bfc0e13a1d5613/users/78936ce51fde43c6a3db393b591d29f1/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:04.209453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac605-59a2-4154-ab51-f3e443898f4f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:04.210021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac605-59a2-4154-ab51-f3e443898f4f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:04.210529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac605-59a2-4154-ab51-f3e443898f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:04.288721 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-62eac605-59a2-4154-ab51-f3e443898f4f None None] MFA Rules not processed for user `78936ce51fde43c6a3db393b591d29f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:04.295519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-62eac605-59a2-4154-ab51-f3e443898f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:04.477550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1035/2062] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:04.493855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bffde4-2186-4eac-b7fd-2691b0e063b8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:04.641538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bffde4-2186-4eac-b7fd-2691b0e063b8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:04.648904 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075385b-7714-4378-ab9c-fed8c0427d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:04.650519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075385b-7714-4378-ab9c-fed8c0427d93 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:04.651196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075385b-7714-4378-ab9c-fed8c0427d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:04.651881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075385b-7714-4378-ab9c-fed8c0427d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:04.713243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:04.810201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075385b-7714-4378-ab9c-fed8c0427d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:04.812311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075385b-7714-4378-ab9c-fed8c0427d93 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:04.844147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1028/2063] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:06.288428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac605-59a2-4154-ab51-f3e443898f4f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:06.304814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac605-59a2-4154-ab51-f3e443898f4f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:06.313748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6918c-efd7-409b-8813-4c8d3df87668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:06.314812 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6918c-efd7-409b-8813-4c8d3df87668 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:06.315611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6918c-efd7-409b-8813-4c8d3df87668 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:06.316132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6918c-efd7-409b-8813-4c8d3df87668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:06.358058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:06.425319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6918c-efd7-409b-8813-4c8d3df87668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:06.428202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6918c-efd7-409b-8813-4c8d3df87668 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:06.466957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1036/2064] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:06.913870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075385b-7714-4378-ab9c-fed8c0427d93 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:06.916449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7075385b-7714-4378-ab9c-fed8c0427d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:07.110562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075385b-7714-4378-ab9c-fed8c0427d93 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:07.117458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:07.118170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:07.119134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:07.120344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] PATH_INFO: `/v3/users/aee3a15e73ea47498195ecca096b1c4c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:07.122622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee3a15e73ea47498195ecca096b1c4c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:07.127463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:07.277877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee3a15e73ea47498195ecca096b1c4c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:07.281503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee3a15e73ea47498195ecca096b1c4c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:07.283376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee3a15e73ea47498195ecca096b1c4c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:07.317148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee3a15e73ea47498195ecca096b1c4c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:07.333890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee3a15e73ea47498195ecca096b1c4c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:07.358033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1029/2065] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:06 2022] DELETE /identity/v3/users/aee3a15e73ea47498195ecca096b1c4c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:07.360403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b029-6d59-46eb-894b-3fa479778a08 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:07.361270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b029-6d59-46eb-894b-3fa479778a08 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:07.361270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b029-6d59-46eb-894b-3fa479778a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:07.414948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8ea7b029-6d59-46eb-894b-3fa479778a08 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:07.418193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8ea7b029-6d59-46eb-894b-3fa479778a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:07.753198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1037/2066] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:07.845996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:07.848991 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:08.002969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:08.042346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0d12-9a9a-4b1e-be9e-941bdd1d2587 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:08.059428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5d778-bb0e-4146-81af-c1c07190530e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:08.060341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5d778-bb0e-4146-81af-c1c07190530e service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:08.060744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5d778-bb0e-4146-81af-c1c07190530e service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:08.061150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5d778-bb0e-4146-81af-c1c07190530e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:08.094476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5d778-bb0e-4146-81af-c1c07190530e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:08.116616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5d778-bb0e-4146-81af-c1c07190530e service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:08.148620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1030/2067] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:08.183033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7b029-6d59-46eb-894b-3fa479778a08 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:08.184921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8ea7b029-6d59-46eb-894b-3fa479778a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:08.344255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7b029-6d59-46eb-894b-3fa479778a08 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:08.353239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:08.355854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:08.357011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:08.357714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:08.363686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:08.566179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:08.569427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:08.599867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1038/2068] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:09.157469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5d778-bb0e-4146-81af-c1c07190530e service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:09.162132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7dd5d778-bb0e-4146-81af-c1c07190530e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:09.216837 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5d778-bb0e-4146-81af-c1c07190530e service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:09.227028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:09.230001 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:09.231382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:09.234277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] PATH_INFO: `/v3/projects/3e4067bb2fd14a369a33cf92055258d3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:09.237526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4067bb2fd14a369a33cf92055258d3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:09.245299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:09.414471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:09.416915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:09.435746 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4067bb2fd14a369a33cf92055258d3', 'request_id': 'req-fe983cc8-3053-450b-844f-3a8e06c2d3bd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.457449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4067bb2fd14a369a33cf92055258d3', 'request_id': 'req-fe983cc8-3053-450b-844f-3a8e06c2d3bd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.458526 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a38b5-82ba-42ee-a1c0-89d95afdbebe service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:09.467086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4067bb2fd14a369a33cf92055258d3', 'request_id': 'req-fe983cc8-3053-450b-844f-3a8e06c2d3bd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.496177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:09.496635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] The token cache is being invalidate because project 3e4067bb2fd14a369a33cf92055258d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:09.497089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.497996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.508846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1031/2069] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:09 2022] DELETE /identity/v3/projects/3e4067bb2fd14a369a33cf92055258d3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:09.522716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:09.530760 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:09.630207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:09.630895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:09.631348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:09.631763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] PATH_INFO: `/v3/users/c8969ad404a44181b719c5546230c49a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:09.633427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8969ad404a44181b719c5546230c49a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:09.635827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:09.647093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983cc8-3053-450b-844f-3a8e06c2d3bd admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:09.653234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:09.653978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:09.654354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:09.654885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] PATH_INFO: `/v3/users/ac78f67555c54bf1a8774c694f8646ac` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:09.656388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac78f67555c54bf1a8774c694f8646ac)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:09.658492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:09.702461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8969ad404a44181b719c5546230c49a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.703514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8969ad404a44181b719c5546230c49a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.719481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8969ad404a44181b719c5546230c49a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.724345 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac78f67555c54bf1a8774c694f8646ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.725285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac78f67555c54bf1a8774c694f8646ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.726077 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac78f67555c54bf1a8774c694f8646ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.730992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8969ad404a44181b719c5546230c49a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.741293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8969ad404a44181b719c5546230c49a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.747560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac78f67555c54bf1a8774c694f8646ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.749591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1039/2070] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:09 2022] DELETE /identity/v3/users/c8969ad404a44181b719c5546230c49a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:09.754372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:09.762448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac78f67555c54bf1a8774c694f8646ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:09.779602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1032/2071] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:09 2022] DELETE /identity/v3/users/ac78f67555c54bf1a8774c694f8646ac => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:10.163657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:10.166385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:10.357435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aa8d2-0f16-4866-a442-7a9224a007e5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:10.417733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:10.418844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:10.420378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:10.457552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:10.458869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:10.459922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:10.461503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] PATH_INFO: `/v3/projects/9c423ab6ae8843d0a65df1f706a3c41e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:10.464598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c423ab6ae8843d0a65df1f706a3c41e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:10.467676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:10.548297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c423ab6ae8843d0a65df1f706a3c41e', 'request_id': 'req-852a40a1-545e-4b40-b7d2-23b2db5285fa'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.552736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c336-2d03-4e21-8a51-3aae601999dd admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:10.559881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c423ab6ae8843d0a65df1f706a3c41e', 'request_id': 'req-852a40a1-545e-4b40-b7d2-23b2db5285fa'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.576010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c423ab6ae8843d0a65df1f706a3c41e', 'request_id': 'req-852a40a1-545e-4b40-b7d2-23b2db5285fa'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.599766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] The token cache is being invalidate because project 9c423ab6ae8843d0a65df1f706a3c41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:10.600233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.601483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.604942 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1040/2072] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:10 2022] DELETE /identity/v3/projects/9c423ab6ae8843d0a65df1f706a3c41e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:10.607116 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:10.609438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:10.664860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:10.664860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:10.664860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:10.665436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] PATH_INFO: `/v3/projects/310a1d7ce4ee4c27911ef9c85a764988` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:10.667222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=310a1d7ce4ee4c27911ef9c85a764988)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:10.671036 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:10.689947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a40a1-545e-4b40-b7d2-23b2db5285fa admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:10.696772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b96be-ba8d-499c-9331-95028700dcea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:10.697450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b96be-ba8d-499c-9331-95028700dcea service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:10.697891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b96be-ba8d-499c-9331-95028700dcea service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:10.698171 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b96be-ba8d-499c-9331-95028700dcea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:10.700995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-653b96be-ba8d-499c-9331-95028700dcea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:10.759679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310a1d7ce4ee4c27911ef9c85a764988', 'request_id': 'req-b00a2f05-85ce-45b4-9cab-dd6b946521bb'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.772717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310a1d7ce4ee4c27911ef9c85a764988', 'request_id': 'req-b00a2f05-85ce-45b4-9cab-dd6b946521bb'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.790735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310a1d7ce4ee4c27911ef9c85a764988', 'request_id': 'req-b00a2f05-85ce-45b4-9cab-dd6b946521bb'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.799715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b96be-ba8d-499c-9331-95028700dcea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:10.803427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b96be-ba8d-499c-9331-95028700dcea service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:10.819806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1041/2073] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:10.821831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57696e11-9e9d-4cbc-bf2f-8d92a167e2a5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:10.822266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57696e11-9e9d-4cbc-bf2f-8d92a167e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:10.822572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57696e11-9e9d-4cbc-bf2f-8d92a167e2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:10.825721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] The token cache is being invalidate because project 310a1d7ce4ee4c27911ef9c85a764988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:10.826177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.827379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:10.834756 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1033/2074] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:10 2022] DELETE /identity/v3/projects/310a1d7ce4ee4c27911ef9c85a764988 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:10.839200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:10.841993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:10.858494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-57696e11-9e9d-4cbc-bf2f-8d92a167e2a5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:10.860710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-57696e11-9e9d-4cbc-bf2f-8d92a167e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:10.888090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:10.899105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:10.996932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a2f05-85ce-45b4-9cab-dd6b946521bb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:11.008908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:11.009671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.010015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.010398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] PATH_INFO: `/v3/users/1192e718efad45508f00e252323009ac` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:11.012109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1192e718efad45508f00e252323009ac)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:11.015015 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:11.021672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1042/2075] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:11.036751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66970e7-2a36-4830-ad0c-89c047b39be7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.037035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66970e7-2a36-4830-ad0c-89c047b39be7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.037306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66970e7-2a36-4830-ad0c-89c047b39be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:11.066836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a66970e7-2a36-4830-ad0c-89c047b39be7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:11.068187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a66970e7-2a36-4830-ad0c-89c047b39be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:11.091364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1043/2076] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:11.093522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66970e7-2a36-4830-ad0c-89c047b39be7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:11.117904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66970e7-2a36-4830-ad0c-89c047b39be7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:11.125879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1192e718efad45508f00e252323009ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:11.126998 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1192e718efad45508f00e252323009ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:11.127185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:11.128241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1192e718efad45508f00e252323009ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:11.128479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.129115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.129752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:11.131144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:34:11.132124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:11.135110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:11.156339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1192e718efad45508f00e252323009ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:11.166541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1044/2077] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:34:11.172872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1192e718efad45508f00e252323009ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:11.173870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:11.177470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:11.198592 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1034/2078] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:10 2022] DELETE /identity/v3/users/1192e718efad45508f00e252323009ac => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:11.207299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef383d-978e-462b-b1bb-b569f587c2af admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:11.347518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1a6e-7b52-4f0a-a6bc-cfaec54fd78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:11.348360 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1a6e-7b52-4f0a-a6bc-cfaec54fd78e admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.348626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1a6e-7b52-4f0a-a6bc-cfaec54fd78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.348965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1a6e-7b52-4f0a-a6bc-cfaec54fd78e admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:11.349687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1a6e-7b52-4f0a-a6bc-cfaec54fd78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:11.352266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1a6e-7b52-4f0a-a6bc-cfaec54fd78e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:11.391717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1045/2079] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:11 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:11.397193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:11.433630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99c079-4516-4e40-acfd-c25934ce09e2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:11.624705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500667a6-1da4-4b02-bfaa-9468965525b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:11.626189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500667a6-1da4-4b02-bfaa-9468965525b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.626919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500667a6-1da4-4b02-bfaa-9468965525b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.627500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500667a6-1da4-4b02-bfaa-9468965525b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:11.642943 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500667a6-1da4-4b02-bfaa-9468965525b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:11.648242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500667a6-1da4-4b02-bfaa-9468965525b3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:11.724139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1035/2080] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:11 2022] POST /identity/v3/users => generated 297 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:11.726361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1a6e-7b52-4f0a-a6bc-cfaec54fd78e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:11.754321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1a6e-7b52-4f0a-a6bc-cfaec54fd78e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:11.764994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653849e6-5608-4b00-aa7f-d8b159f955f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:11.767047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653849e6-5608-4b00-aa7f-d8b159f955f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.768032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653849e6-5608-4b00-aa7f-d8b159f955f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.768032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653849e6-5608-4b00-aa7f-d8b159f955f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:11.769432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653849e6-5608-4b00-aa7f-d8b159f955f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:11.775968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653849e6-5608-4b00-aa7f-d8b159f955f0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:11.801534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1046/2081] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:11.807684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500667a6-1da4-4b02-bfaa-9468965525b3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:11.823453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653849e6-5608-4b00-aa7f-d8b159f955f0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:11.826980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-653849e6-5608-4b00-aa7f-d8b159f955f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:11.832357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500667a6-1da4-4b02-bfaa-9468965525b3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:11.844962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2a352-813c-4a76-90a3-aa4341791ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:11.845735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2a352-813c-4a76-90a3-aa4341791ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.847759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2a352-813c-4a76-90a3-aa4341791ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.848095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2a352-813c-4a76-90a3-aa4341791ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:11.849334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2a352-813c-4a76-90a3-aa4341791ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:11.851554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2a352-813c-4a76-90a3-aa4341791ec2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:11.874448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653849e6-5608-4b00-aa7f-d8b159f955f0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:11.879534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1036/2082] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:11.885102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:11.889996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2a352-813c-4a76-90a3-aa4341791ec2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:11.903204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.903651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.904013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] PATH_INFO: `/v3/projects/9ef560dae8784e56bf7e9fce87858767` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:11.908464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef560dae8784e56bf7e9fce87858767)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:11.910818 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2a352-813c-4a76-90a3-aa4341791ec2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:11.911888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:11.920942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975fa7-f0fb-4f5f-b17f-bba59a603d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:11.920942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975fa7-f0fb-4f5f-b17f-bba59a603d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.920942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975fa7-f0fb-4f5f-b17f-bba59a603d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.920942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975fa7-f0fb-4f5f-b17f-bba59a603d22 admin admin] PATH_INFO: `/v3/projects/66a102abeb7f46a292a49d1f022190e7/users/ae4f7f8855b5445d863a825ce921c982/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:11.959603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c975fa7-f0fb-4f5f-b17f-bba59a603d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a102abeb7f46a292a49d1f022190e7, user_id=ae4f7f8855b5445d863a825ce921c982, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:11.963653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c975fa7-f0fb-4f5f-b17f-bba59a603d22 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:11.970051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:11.993223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1037/2083] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:11 2022] PUT /identity/v3/projects/66a102abeb7f46a292a49d1f022190e7/users/ae4f7f8855b5445d863a825ce921c982/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:11.998094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5bd33-7526-49db-a15a-bf14ad08686b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:11.998404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5bd33-7526-49db-a15a-bf14ad08686b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:11.998718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5bd33-7526-49db-a15a-bf14ad08686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.014508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef560dae8784e56bf7e9fce87858767', 'request_id': 'req-ce1c5445-bee5-4680-8a61-96d81eb45688'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:12.032002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef560dae8784e56bf7e9fce87858767', 'request_id': 'req-ce1c5445-bee5-4680-8a61-96d81eb45688'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:12.035667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-98d5bd33-7526-49db-a15a-bf14ad08686b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:12.037598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-98d5bd33-7526-49db-a15a-bf14ad08686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:12.052642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef560dae8784e56bf7e9fce87858767', 'request_id': 'req-ce1c5445-bee5-4680-8a61-96d81eb45688'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:12.065374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:12.087323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] The token cache is being invalidate because project 9ef560dae8784e56bf7e9fce87858767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:12.087992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:12.091287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ce1c5445-bee5-4680-8a61-96d81eb45688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:12.096849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1047/2084] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:11 2022] DELETE /identity/v3/projects/9ef560dae8784e56bf7e9fce87858767 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:12.120549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b18fea-13e3-4a59-9fba-7f07bc10f87b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.121587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b18fea-13e3-4a59-9fba-7f07bc10f87b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.121930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b18fea-13e3-4a59-9fba-7f07bc10f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.165063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-14b18fea-13e3-4a59-9fba-7f07bc10f87b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:12.167481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-14b18fea-13e3-4a59-9fba-7f07bc10f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:12.175279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1038/2085] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:12.190755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1048/2086] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:12.191238 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5bd33-7526-49db-a15a-bf14ad08686b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:12.204690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-98d5bd33-7526-49db-a15a-bf14ad08686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:12.205642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f92751-e9ed-4aa0-85cb-bf08d1fe2b6d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.206520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f92751-e9ed-4aa0-85cb-bf08d1fe2b6d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.207689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f92751-e9ed-4aa0-85cb-bf08d1fe2b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.248622 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-44f92751-e9ed-4aa0-85cb-bf08d1fe2b6d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:12.249668 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-44f92751-e9ed-4aa0-85cb-bf08d1fe2b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:12.265270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1049/2087] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:12.270253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f92751-e9ed-4aa0-85cb-bf08d1fe2b6d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:12.283894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f92751-e9ed-4aa0-85cb-bf08d1fe2b6d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:12.289310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6085-9f9a-4970-b248-bd62c872b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:12.289951 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6085-9f9a-4970-b248-bd62c872b63f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.290262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6085-9f9a-4970-b248-bd62c872b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.290775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6085-9f9a-4970-b248-bd62c872b63f admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.292959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6085-9f9a-4970-b248-bd62c872b63f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:34:12.293269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6085-9f9a-4970-b248-bd62c872b63f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:12.294960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6085-9f9a-4970-b248-bd62c872b63f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:12.317909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1050/2088] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:34:12.324319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6085-9f9a-4970-b248-bd62c872b63f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:12.337343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6085-9f9a-4970-b248-bd62c872b63f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:12.345976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76d9e6-535e-4904-b66b-73f6bbf4b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:12.346947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d9e6-535e-4904-b66b-73f6bbf4b4cc admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.347147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d9e6-535e-4904-b66b-73f6bbf4b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.347428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d9e6-535e-4904-b66b-73f6bbf4b4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.349040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76d9e6-535e-4904-b66b-73f6bbf4b4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:12.354884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76d9e6-535e-4904-b66b-73f6bbf4b4cc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:12.367933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5bd33-7526-49db-a15a-bf14ad08686b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:12.376387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb999d-44a7-4d44-be95-981bb60ba0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:12.378619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb999d-44a7-4d44-be95-981bb60ba0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.380494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb999d-44a7-4d44-be95-981bb60ba0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.381076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb999d-44a7-4d44-be95-981bb60ba0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.400777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb999d-44a7-4d44-be95-981bb60ba0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:12.403681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb999d-44a7-4d44-be95-981bb60ba0b6 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:12.411371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1051/2089] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:12 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:12.418066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76d9e6-535e-4904-b66b-73f6bbf4b4cc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:12.424076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1039/2090] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:34:12.550747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76d9e6-535e-4904-b66b-73f6bbf4b4cc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:12.558264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff057c59-6173-4d79-a2c8-38feca90ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:12.559198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057c59-6173-4d79-a2c8-38feca90ec6c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.559611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057c59-6173-4d79-a2c8-38feca90ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.560051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057c59-6173-4d79-a2c8-38feca90ec6c admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.561047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff057c59-6173-4d79-a2c8-38feca90ec6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:12.564556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff057c59-6173-4d79-a2c8-38feca90ec6c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:12.595450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1052/2091] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:12 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:12.596611 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb999d-44a7-4d44-be95-981bb60ba0b6 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:12.612908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb999d-44a7-4d44-be95-981bb60ba0b6 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:12.620791 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4a777-d435-4fb6-92fc-c12fb27b7dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:12.622038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4a777-d435-4fb6-92fc-c12fb27b7dea admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.622557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4a777-d435-4fb6-92fc-c12fb27b7dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.623335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4a777-d435-4fb6-92fc-c12fb27b7dea admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.624209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4a777-d435-4fb6-92fc-c12fb27b7dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:12.627148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4a777-d435-4fb6-92fc-c12fb27b7dea admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:12.643411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1040/2092] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:34:12.650029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff057c59-6173-4d79-a2c8-38feca90ec6c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:12.667548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff057c59-6173-4d79-a2c8-38feca90ec6c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:12.674694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac87c8-42dc-4d1a-996c-ad047e88bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:12.675757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac87c8-42dc-4d1a-996c-ad047e88bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.676240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac87c8-42dc-4d1a-996c-ad047e88bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.676714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac87c8-42dc-4d1a-996c-ad047e88bbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.677883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac87c8-42dc-4d1a-996c-ad047e88bbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:12.680110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac87c8-42dc-4d1a-996c-ad047e88bbcb admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:12.706938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1053/2093] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:12.714722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4a777-d435-4fb6-92fc-c12fb27b7dea admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:12.734462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4a777-d435-4fb6-92fc-c12fb27b7dea admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:12.742422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee60e0-c9be-4b5a-9770-b0caf5607fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:12.743501 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee60e0-c9be-4b5a-9770-b0caf5607fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.743961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee60e0-c9be-4b5a-9770-b0caf5607fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.744423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee60e0-c9be-4b5a-9770-b0caf5607fa5 admin admin] PATH_INFO: `/v3/projects/e2bf5cd3758a4788a4e59e4e25cb8fe7/users/1016859f781047059d56946374b1719c/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.773973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee60e0-c9be-4b5a-9770-b0caf5607fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2bf5cd3758a4788a4e59e4e25cb8fe7, user_id=1016859f781047059d56946374b1719c, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:12.780188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee60e0-c9be-4b5a-9770-b0caf5607fa5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:12.815053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1041/2094] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:12 2022] PUT /identity/v3/projects/e2bf5cd3758a4788a4e59e4e25cb8fe7/users/1016859f781047059d56946374b1719c/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:12.829744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a292f-ae3d-4d12-882e-80a79253130d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:12.830295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a292f-ae3d-4d12-882e-80a79253130d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:12.830624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a292f-ae3d-4d12-882e-80a79253130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:12.882044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-553a292f-ae3d-4d12-882e-80a79253130d None None] MFA Rules not processed for user `1016859f781047059d56946374b1719c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:12.883860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-553a292f-ae3d-4d12-882e-80a79253130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:13.016483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1054/2095] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:13.022731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee60e0-c9be-4b5a-9770-b0caf5607fa5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:13.106729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee60e0-c9be-4b5a-9770-b0caf5607fa5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:13.116115 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85539447-577f-4792-9347-418af5d48c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:13.117941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85539447-577f-4792-9347-418af5d48c9b admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:13.118426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85539447-577f-4792-9347-418af5d48c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:13.118891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85539447-577f-4792-9347-418af5d48c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:13.119798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85539447-577f-4792-9347-418af5d48c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:13.122940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85539447-577f-4792-9347-418af5d48c9b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:13.137821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:13.176070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1042/2096] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:13 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:13.184556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a292f-ae3d-4d12-882e-80a79253130d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:13.216745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a292f-ae3d-4d12-882e-80a79253130d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:13.248889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85539447-577f-4792-9347-418af5d48c9b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:13.250448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:13.252059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-85539447-577f-4792-9347-418af5d48c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:13.360176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5945c0-21cc-4f5e-ab9a-c5261e7034ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:13.361393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5945c0-21cc-4f5e-ab9a-c5261e7034ee admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:13.361858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5945c0-21cc-4f5e-ab9a-c5261e7034ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:13.363612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5945c0-21cc-4f5e-ab9a-c5261e7034ee admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:13.364952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5945c0-21cc-4f5e-ab9a-c5261e7034ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:13.368069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5945c0-21cc-4f5e-ab9a-c5261e7034ee admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:13.423248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1055/2097] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:13 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:13.428400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5945c0-21cc-4f5e-ab9a-c5261e7034ee admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:13.429295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85539447-577f-4792-9347-418af5d48c9b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:13.438176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:13.439393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:13.439852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:13.440399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] PATH_INFO: `/v3/users/71747f16927645ae9506b758039dcba8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:13.442738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71747f16927645ae9506b758039dcba8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:13.446626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:13.455513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5945c0-21cc-4f5e-ab9a-c5261e7034ee admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:13.462098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf70d3f-8473-4abd-9e8b-c98aebc965f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:13.462842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf70d3f-8473-4abd-9e8b-c98aebc965f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:13.463118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf70d3f-8473-4abd-9e8b-c98aebc965f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:13.463393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf70d3f-8473-4abd-9e8b-c98aebc965f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:13.464069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf70d3f-8473-4abd-9e8b-c98aebc965f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:13.466404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf70d3f-8473-4abd-9e8b-c98aebc965f1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:13.492303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1056/2098] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:13.497259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf70d3f-8473-4abd-9e8b-c98aebc965f1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:13.520108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf70d3f-8473-4abd-9e8b-c98aebc965f1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:13.526131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918976f0-b9ff-4563-b6e9-53300a1e3a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:13.526778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918976f0-b9ff-4563-b6e9-53300a1e3a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:13.527147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918976f0-b9ff-4563-b6e9-53300a1e3a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:13.527393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918976f0-b9ff-4563-b6e9-53300a1e3a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:13.528155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918976f0-b9ff-4563-b6e9-53300a1e3a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:13.529991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918976f0-b9ff-4563-b6e9-53300a1e3a3b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:13.546946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1057/2099] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:13.551348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918976f0-b9ff-4563-b6e9-53300a1e3a3b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:13.568463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918976f0-b9ff-4563-b6e9-53300a1e3a3b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:13.575882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590e151-f812-4eae-b609-15524b1ec4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:13.576794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590e151-f812-4eae-b609-15524b1ec4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:13.577403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590e151-f812-4eae-b609-15524b1ec4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:13.577798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590e151-f812-4eae-b609-15524b1ec4cf admin admin] PATH_INFO: `/v3/projects/02c00d7948f543358401743ab45b92ad/users/0af34095ded34851ab14c6cf33aafad5/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:13.583100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71747f16927645ae9506b758039dcba8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:13.586702 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71747f16927645ae9506b758039dcba8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:13.587936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71747f16927645ae9506b758039dcba8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:13.614748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71747f16927645ae9506b758039dcba8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:13.617009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590e151-f812-4eae-b609-15524b1ec4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c00d7948f543358401743ab45b92ad, user_id=0af34095ded34851ab14c6cf33aafad5, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:13.623089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590e151-f812-4eae-b609-15524b1ec4cf admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:13.633689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8ed4978e-ca5d-4ddf-b7d1-6d0bd3f22d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71747f16927645ae9506b758039dcba8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:13.663191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1058/2100] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:13 2022] PUT /identity/v3/projects/02c00d7948f543358401743ab45b92ad/users/0af34095ded34851ab14c6cf33aafad5/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:13.669466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaa081-e93d-4639-93bb-990fc9b7f411 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:13.670595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaa081-e93d-4639-93bb-990fc9b7f411 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:13.671147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaa081-e93d-4639-93bb-990fc9b7f411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:13.680620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1043/2101] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:13 2022] DELETE /identity/v3/users/71747f16927645ae9506b758039dcba8 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:13.684149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1a9da-331d-4f5c-96df-d98d89ee2a6f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:13.684498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1a9da-331d-4f5c-96df-d98d89ee2a6f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:13.685146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1a9da-331d-4f5c-96df-d98d89ee2a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:13.725304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-96f1a9da-331d-4f5c-96df-d98d89ee2a6f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:13.726785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-96f1a9da-331d-4f5c-96df-d98d89ee2a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:13.740405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6fbaa081-e93d-4639-93bb-990fc9b7f411 None None] MFA Rules not processed for user `0af34095ded34851ab14c6cf33aafad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:13.743252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6fbaa081-e93d-4639-93bb-990fc9b7f411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:13.896419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1059/2102] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:13.897696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaa081-e93d-4639-93bb-990fc9b7f411 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:13.899180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6fbaa081-e93d-4639-93bb-990fc9b7f411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:13.900204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1044/2103] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:13.916399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1a9da-331d-4f5c-96df-d98d89ee2a6f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:13.919031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-96f1a9da-331d-4f5c-96df-d98d89ee2a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:13.932605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaa081-e93d-4639-93bb-990fc9b7f411 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:13.942371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc366c-38f7-42e3-92e4-30dd16165402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:13.943647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc366c-38f7-42e3-92e4-30dd16165402 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:13.944137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:13.944291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc366c-38f7-42e3-92e4-30dd16165402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:13.944619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc366c-38f7-42e3-92e4-30dd16165402 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:13.946080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc366c-38f7-42e3-92e4-30dd16165402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:13.950232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc366c-38f7-42e3-92e4-30dd16165402 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:14.036096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1060/2104] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:13 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:14.045903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc366c-38f7-42e3-92e4-30dd16165402 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:14.134324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:14.154979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1a9da-331d-4f5c-96df-d98d89ee2a6f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:14.233189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed83dff-36c0-4f79-8843-fd1e48bb45ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:14.233333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc366c-38f7-42e3-92e4-30dd16165402 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:14.234149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed83dff-36c0-4f79-8843-fd1e48bb45ab service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:14.234430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed83dff-36c0-4f79-8843-fd1e48bb45ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:14.234739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed83dff-36c0-4f79-8843-fd1e48bb45ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:14.247906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf4214-ed69-4444-9033-29143e330d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:14.248568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf4214-ed69-4444-9033-29143e330d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:14.248882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf4214-ed69-4444-9033-29143e330d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:14.249149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf4214-ed69-4444-9033-29143e330d58 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:14.249792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf4214-ed69-4444-9033-29143e330d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:14.251702 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed83dff-36c0-4f79-8843-fd1e48bb45ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:14.254424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed83dff-36c0-4f79-8843-fd1e48bb45ab service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:14.257246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf4214-ed69-4444-9033-29143e330d58 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:14.275164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1045/2105] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:14.296909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1061/2106] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:14 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:14.301960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed83dff-36c0-4f79-8843-fd1e48bb45ab service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:14.320348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed83dff-36c0-4f79-8843-fd1e48bb45ab service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:14.339105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869aa1a-11d9-4078-b2dc-6e56a5132ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:14.340292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869aa1a-11d9-4078-b2dc-6e56a5132ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:14.340565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869aa1a-11d9-4078-b2dc-6e56a5132ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:14.341047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869aa1a-11d9-4078-b2dc-6e56a5132ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:14.343112 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869aa1a-11d9-4078-b2dc-6e56a5132ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:14.347785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869aa1a-11d9-4078-b2dc-6e56a5132ed7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:14.372134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1046/2107] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:14.377074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf4214-ed69-4444-9033-29143e330d58 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:14.394761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf4214-ed69-4444-9033-29143e330d58 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:14.407785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfb8ba-dec3-4401-8b43-c282f8982ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:14.412680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfb8ba-dec3-4401-8b43-c282f8982ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:14.413611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfb8ba-dec3-4401-8b43-c282f8982ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:14.414336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfb8ba-dec3-4401-8b43-c282f8982ba8 admin admin] PATH_INFO: `/v3/projects/04f8e4a3b87e4ac98ba35f2e7765f032/users/1ca48d788251406dbd773deb1b205b48/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:14.440001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfb8ba-dec3-4401-8b43-c282f8982ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f8e4a3b87e4ac98ba35f2e7765f032, user_id=1ca48d788251406dbd773deb1b205b48, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:14.444506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfb8ba-dec3-4401-8b43-c282f8982ba8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:14.466924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1062/2108] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:14 2022] PUT /identity/v3/projects/04f8e4a3b87e4ac98ba35f2e7765f032/users/1ca48d788251406dbd773deb1b205b48/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:14.475566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869aa1a-11d9-4078-b2dc-6e56a5132ed7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:14.534076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869aa1a-11d9-4078-b2dc-6e56a5132ed7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:14.710712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86373b1-3510-4ed1-bab2-220fb5774d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:14.714504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86373b1-3510-4ed1-bab2-220fb5774d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:14.715132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86373b1-3510-4ed1-bab2-220fb5774d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:14.715132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86373b1-3510-4ed1-bab2-220fb5774d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:14.715825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86373b1-3510-4ed1-bab2-220fb5774d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:14.717560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86373b1-3510-4ed1-bab2-220fb5774d3e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:14.734271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1047/2109] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:14.744347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfb8ba-dec3-4401-8b43-c282f8982ba8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:14.767832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfb8ba-dec3-4401-8b43-c282f8982ba8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:14.778514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca45b4-26a1-4839-bd05-2edf4cafeba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:14.779857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca45b4-26a1-4839-bd05-2edf4cafeba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:14.780398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca45b4-26a1-4839-bd05-2edf4cafeba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:14.780779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca45b4-26a1-4839-bd05-2edf4cafeba7 admin admin] PATH_INFO: `/v3/projects/04f8e4a3b87e4ac98ba35f2e7765f032/users/1ca48d788251406dbd773deb1b205b48/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:14.790166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca45b4-26a1-4839-bd05-2edf4cafeba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f8e4a3b87e4ac98ba35f2e7765f032, user_id=1ca48d788251406dbd773deb1b205b48, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:14.808439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca45b4-26a1-4839-bd05-2edf4cafeba7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:14.830407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86373b1-3510-4ed1-bab2-220fb5774d3e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:14.833603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f86373b1-3510-4ed1-bab2-220fb5774d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:14.867607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1063/2110] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:14 2022] PUT /identity/v3/projects/04f8e4a3b87e4ac98ba35f2e7765f032/users/1ca48d788251406dbd773deb1b205b48/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:14.874638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86373b1-3510-4ed1-bab2-220fb5774d3e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:14.881462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fa60d-42e4-4719-b565-d6258dca506f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:14.882121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fa60d-42e4-4719-b565-d6258dca506f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:14.882771 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fa60d-42e4-4719-b565-d6258dca506f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:14.959016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ff2fa60d-42e4-4719-b565-d6258dca506f None None] MFA Rules not processed for user `1ca48d788251406dbd773deb1b205b48`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:14.961600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ff2fa60d-42e4-4719-b565-d6258dca506f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:15.035498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:15.067184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:15.068111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:15.068578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:15.069044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] PATH_INFO: `/v3/projects/e9a5fd3a934649c18e4026a82632f9fe` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:15.071158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a5fd3a934649c18e4026a82632f9fe)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:15.074929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:15.146746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1064/2111] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:15.160998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fa60d-42e4-4719-b565-d6258dca506f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:15.164172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ff2fa60d-42e4-4719-b565-d6258dca506f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:15.234920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a5fd3a934649c18e4026a82632f9fe', 'request_id': 'req-3637a025-03d5-444f-8be1-704a648bc1e4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.263063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a5fd3a934649c18e4026a82632f9fe', 'request_id': 'req-3637a025-03d5-444f-8be1-704a648bc1e4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.290735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a5fd3a934649c18e4026a82632f9fe', 'request_id': 'req-3637a025-03d5-444f-8be1-704a648bc1e4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.373058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] The token cache is being invalidate because project e9a5fd3a934649c18e4026a82632f9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:15.373727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.374968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.379931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1048/2112] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:14 2022] DELETE /identity/v3/projects/e9a5fd3a934649c18e4026a82632f9fe => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:15.386128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:15.393402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:15.399089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fa60d-42e4-4719-b565-d6258dca506f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:15.444207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:15.535323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:15.537319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:15.538027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:15.538593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:15.542573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:15.610719 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637a025-03d5-444f-8be1-704a648bc1e4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:15.616336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:15.617044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:15.617678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:15.617968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] PATH_INFO: `/v3/users/7dd537f8991a48dcb27faf12471ef7a8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:15.620196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd537f8991a48dcb27faf12471ef7a8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:15.622883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:15.719005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:15.720676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:15.725607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd537f8991a48dcb27faf12471ef7a8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.728449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd537f8991a48dcb27faf12471ef7a8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.729491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd537f8991a48dcb27faf12471ef7a8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.735899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1065/2113] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:15.754926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd537f8991a48dcb27faf12471ef7a8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.767773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd537f8991a48dcb27faf12471ef7a8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:15.796523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1049/2114] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:15 2022] DELETE /identity/v3/users/7dd537f8991a48dcb27faf12471ef7a8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:15.818944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:15.826252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:15.834428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:15.838251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:15.849839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:15.915158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1ad6-648b-4580-8413-1976098a6b5b service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:15.969863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44af09-3df1-478f-b945-5bcf7561e6cc admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:15.988368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c97b6a-1ce4-4b0c-9f5e-900c1146b59e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:15.989464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c97b6a-1ce4-4b0c-9f5e-900c1146b59e service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:15.993476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c97b6a-1ce4-4b0c-9f5e-900c1146b59e service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:15.994199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c97b6a-1ce4-4b0c-9f5e-900c1146b59e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:16.002400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a1c97b6a-1ce4-4b0c-9f5e-900c1146b59e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:16.132438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:16.137208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:16.137208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:16.139449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] PATH_INFO: `/v3/users/7706b0aa5b0c433d8a33a36f4b8a8c40` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:16.145470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7706b0aa5b0c433d8a33a36f4b8a8c40)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:16.150999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:16.208321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c97b6a-1ce4-4b0c-9f5e-900c1146b59e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:16.210406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c97b6a-1ce4-4b0c-9f5e-900c1146b59e service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:16.232849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1050/2115] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:16.318783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7706b0aa5b0c433d8a33a36f4b8a8c40'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:16.321020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7706b0aa5b0c433d8a33a36f4b8a8c40'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:16.369709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7706b0aa5b0c433d8a33a36f4b8a8c40'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:16.391371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7706b0aa5b0c433d8a33a36f4b8a8c40'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:16.396776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:16.417741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7706b0aa5b0c433d8a33a36f4b8a8c40'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:16.447734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1066/2116] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:15 2022] DELETE /identity/v3/users/7706b0aa5b0c433d8a33a36f4b8a8c40 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:16.454101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e06fc-88cc-446f-84fe-e2a74066574a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:16.454787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e06fc-88cc-446f-84fe-e2a74066574a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:16.455299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e06fc-88cc-446f-84fe-e2a74066574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:16.542177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bd9e06fc-88cc-446f-84fe-e2a74066574a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:16.553605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bd9e06fc-88cc-446f-84fe-e2a74066574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:16.768017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:16.771260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:16.786262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1051/2117] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:16.820055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca3fb7-bcad-4ae7-b368-0115427697c3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:16.835050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e06fc-88cc-446f-84fe-e2a74066574a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:16.841107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bd9e06fc-88cc-446f-84fe-e2a74066574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:16.851872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:16.852780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:16.853241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:16.853694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] PATH_INFO: `/v3/projects/f7a6300beb824430abe7345262b369b1` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:16.859311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a6300beb824430abe7345262b369b1)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:16.867455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:16.997949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a6300beb824430abe7345262b369b1', 'request_id': 'req-37bee722-c9bc-49e5-9edd-00dd77a06b8e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.009390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a6300beb824430abe7345262b369b1', 'request_id': 'req-37bee722-c9bc-49e5-9edd-00dd77a06b8e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.010123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e06fc-88cc-446f-84fe-e2a74066574a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:17.032544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:17.032831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a6300beb824430abe7345262b369b1', 'request_id': 'req-37bee722-c9bc-49e5-9edd-00dd77a06b8e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.090828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] The token cache is being invalidate because project f7a6300beb824430abe7345262b369b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:17.092231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.096691 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.109521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1067/2118] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:16 2022] DELETE /identity/v3/projects/f7a6300beb824430abe7345262b369b1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:17.117422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:17.123762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:17.125138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926750ea-fa23-49cc-bd53-eb5f5d0d1e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:17.126117 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926750ea-fa23-49cc-bd53-eb5f5d0d1e95 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:17.126429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926750ea-fa23-49cc-bd53-eb5f5d0d1e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:17.126967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926750ea-fa23-49cc-bd53-eb5f5d0d1e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:17.129989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-926750ea-fa23-49cc-bd53-eb5f5d0d1e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:17.276723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee722-c9bc-49e5-9edd-00dd77a06b8e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:17.292353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:17.293053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:17.293377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:17.293675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] PATH_INFO: `/v3/users/2c2780e683d94e76a57d1970a14aa41f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:17.295530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2780e683d94e76a57d1970a14aa41f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:17.298009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:17.418477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2780e683d94e76a57d1970a14aa41f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.419446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2780e683d94e76a57d1970a14aa41f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.427047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926750ea-fa23-49cc-bd53-eb5f5d0d1e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:17.432532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926750ea-fa23-49cc-bd53-eb5f5d0d1e95 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:17.445389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2780e683d94e76a57d1970a14aa41f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.451809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1052/2119] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:34:17.465855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2780e683d94e76a57d1970a14aa41f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.471875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:17.490782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2780e683d94e76a57d1970a14aa41f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:17.510380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1068/2120] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:17 2022] DELETE /identity/v3/users/2c2780e683d94e76a57d1970a14aa41f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:18.048452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926750ea-fa23-49cc-bd53-eb5f5d0d1e95 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:18.075219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926750ea-fa23-49cc-bd53-eb5f5d0d1e95 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:18.201367 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:18.202075 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:18.202378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:18.202688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] PATH_INFO: `/v3/projects/6d79f6be1f9347ad9cc62b791f484738` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:18.206534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d79f6be1f9347ad9cc62b791f484738)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:18.207302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:18.228683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:18.231534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:18.255926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e8706-c1a3-4e05-998c-ae225ae4debc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:18.263895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:18.264677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:18.265160 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:18.265964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] PATH_INFO: `/v3/projects/5e2f4cfc89594ad9a178a8a0334eb14d` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:18.269833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2f4cfc89594ad9a178a8a0334eb14d)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:18.272454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:18.310047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d79f6be1f9347ad9cc62b791f484738', 'request_id': 'req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.324166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d79f6be1f9347ad9cc62b791f484738', 'request_id': 'req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.342237 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d79f6be1f9347ad9cc62b791f484738', 'request_id': 'req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.347878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:18.378863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] The token cache is being invalidate because project 6d79f6be1f9347ad9cc62b791f484738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:18.379457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.380881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a665c6e4-9542-49c7-ab7f-ba6812e8a3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.385149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1053/2121] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:18 2022] DELETE /identity/v3/projects/6d79f6be1f9347ad9cc62b791f484738 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:18.394629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9351fa7-3e00-44d3-9b3b-8d2b1e31a4ed None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:18.395072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9351fa7-3e00-44d3-9b3b-8d2b1e31a4ed None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:18.400844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9351fa7-3e00-44d3-9b3b-8d2b1e31a4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:18.459531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e9351fa7-3e00-44d3-9b3b-8d2b1e31a4ed None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:18.462200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e9351fa7-3e00-44d3-9b3b-8d2b1e31a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:18.475960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2f4cfc89594ad9a178a8a0334eb14d', 'request_id': 'req-43280299-4f95-4986-a09a-8f9348876520'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.516002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2f4cfc89594ad9a178a8a0334eb14d', 'request_id': 'req-43280299-4f95-4986-a09a-8f9348876520'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.535023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2f4cfc89594ad9a178a8a0334eb14d', 'request_id': 'req-43280299-4f95-4986-a09a-8f9348876520'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.585636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] The token cache is being invalidate because project 5e2f4cfc89594ad9a178a8a0334eb14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:18.586056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.586623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:18.596894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1069/2122] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:18 2022] DELETE /identity/v3/projects/5e2f4cfc89594ad9a178a8a0334eb14d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:18.601020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:18.615289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:18.663497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1054/2123] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:18.675022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45892827-2a10-4c5c-9120-43dcd26367f6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:18.676119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45892827-2a10-4c5c-9120-43dcd26367f6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:18.676607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45892827-2a10-4c5c-9120-43dcd26367f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:18.704457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-45892827-2a10-4c5c-9120-43dcd26367f6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:18.706987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-45892827-2a10-4c5c-9120-43dcd26367f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:18.719465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1055/2124] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:18.723788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45892827-2a10-4c5c-9120-43dcd26367f6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:18.736065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45892827-2a10-4c5c-9120-43dcd26367f6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:18.749699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924b0f3-0179-4705-90fb-5d99f26dfece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:18.750813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924b0f3-0179-4705-90fb-5d99f26dfece admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:18.751063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924b0f3-0179-4705-90fb-5d99f26dfece admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:18.751386 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924b0f3-0179-4705-90fb-5d99f26dfece admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:18.752078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924b0f3-0179-4705-90fb-5d99f26dfece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:34:18.752387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924b0f3-0179-4705-90fb-5d99f26dfece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:18.756593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924b0f3-0179-4705-90fb-5d99f26dfece admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:18.795170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1056/2125] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:34:18.796131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924b0f3-0179-4705-90fb-5d99f26dfece admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:18.807272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43280299-4f95-4986-a09a-8f9348876520 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:18.819433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:18.820584 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:18.821025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:18.822268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] PATH_INFO: `/v3/users/78936ce51fde43c6a3db393b591d29f1` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:18.823932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78936ce51fde43c6a3db393b591d29f1)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:18.827790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:18.834860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924b0f3-0179-4705-90fb-5d99f26dfece admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:18.846271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab832139-56da-4df4-a5df-9b299ab027d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:18.848604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832139-56da-4df4-a5df-9b299ab027d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:18.849248 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832139-56da-4df4-a5df-9b299ab027d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:18.849922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab832139-56da-4df4-a5df-9b299ab027d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:18.851496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab832139-56da-4df4-a5df-9b299ab027d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:18.874524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab832139-56da-4df4-a5df-9b299ab027d2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:18.979539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1057/2126] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:18 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:18.989391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab832139-56da-4df4-a5df-9b299ab027d2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:19.019303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78936ce51fde43c6a3db393b591d29f1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:19.019303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78936ce51fde43c6a3db393b591d29f1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:19.059926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78936ce51fde43c6a3db393b591d29f1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:19.080724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78936ce51fde43c6a3db393b591d29f1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:19.096996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:19.110531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78936ce51fde43c6a3db393b591d29f1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:19.158522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1070/2127] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:18 2022] DELETE /identity/v3/users/78936ce51fde43c6a3db393b591d29f1 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:19.261412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab832139-56da-4df4-a5df-9b299ab027d2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:19.361601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89cdf0-ed3c-4587-808f-ff928b93a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:19.363335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89cdf0-ed3c-4587-808f-ff928b93a05e admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:19.363915 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89cdf0-ed3c-4587-808f-ff928b93a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:19.364417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89cdf0-ed3c-4587-808f-ff928b93a05e admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:19.365847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89cdf0-ed3c-4587-808f-ff928b93a05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:19.368699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89cdf0-ed3c-4587-808f-ff928b93a05e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:19.384481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:19.422569 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:19.426153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:19.434993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1058/2128] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:18 2022] POST /identity/v3/users => generated 286 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:19.449184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352184d-dd95-420b-9538-8b0b8ed7b17f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:19.456477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651b3f-3368-4e59-bfb9-a1f0483c8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:19.457776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651b3f-3368-4e59-bfb9-a1f0483c8ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:19.458278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651b3f-3368-4e59-bfb9-a1f0483c8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:19.459799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651b3f-3368-4e59-bfb9-a1f0483c8ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:19.460856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c651b3f-3368-4e59-bfb9-a1f0483c8ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:19.463336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c651b3f-3368-4e59-bfb9-a1f0483c8ad5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:19.485514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89cdf0-ed3c-4587-808f-ff928b93a05e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:19.501651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1071/2129] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:19.508871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89cdf0-ed3c-4587-808f-ff928b93a05e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:19.515398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc74cf-c343-4063-8c07-aefc3a43fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:19.516452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc74cf-c343-4063-8c07-aefc3a43fa8a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:19.517107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc74cf-c343-4063-8c07-aefc3a43fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:19.517607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc74cf-c343-4063-8c07-aefc3a43fa8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:19.518614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc74cf-c343-4063-8c07-aefc3a43fa8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:19.521130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc74cf-c343-4063-8c07-aefc3a43fa8a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:19.548035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651b3f-3368-4e59-bfb9-a1f0483c8ad5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:19.558405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1059/2130] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:19.567588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651b3f-3368-4e59-bfb9-a1f0483c8ad5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:19.577080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4d8bd-1d1c-403b-83a5-9c36e11c898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:19.578640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d8bd-1d1c-403b-83a5-9c36e11c898f admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:19.579609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d8bd-1d1c-403b-83a5-9c36e11c898f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:19.580117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d8bd-1d1c-403b-83a5-9c36e11c898f admin admin] PATH_INFO: `/v3/projects/617398ec060345fd8d0aeb5479f02ad8/users/aa4183d548384aec82f49656ea9eee8c/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:19.641264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4d8bd-1d1c-403b-83a5-9c36e11c898f admin admin] RBAC: Authorizing `identity:create_grant(project_id=617398ec060345fd8d0aeb5479f02ad8, user_id=aa4183d548384aec82f49656ea9eee8c, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:19.646943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4d8bd-1d1c-403b-83a5-9c36e11c898f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:19.694725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1072/2131] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:19 2022] PUT /identity/v3/projects/617398ec060345fd8d0aeb5479f02ad8/users/aa4183d548384aec82f49656ea9eee8c/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:19.698450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f68d-8f65-4cc5-a68b-f1c7bc755426 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:19.699130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f68d-8f65-4cc5-a68b-f1c7bc755426 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:19.699638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f68d-8f65-4cc5-a68b-f1c7bc755426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:19.774400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7695f68d-8f65-4cc5-a68b-f1c7bc755426 None None] MFA Rules not processed for user `aa4183d548384aec82f49656ea9eee8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:19.777394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7695f68d-8f65-4cc5-a68b-f1c7bc755426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:19.917477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1060/2132] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:19.931676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4d8bd-1d1c-403b-83a5-9c36e11c898f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:19.934708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-52c4d8bd-1d1c-403b-83a5-9c36e11c898f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:20.043185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4d8bd-1d1c-403b-83a5-9c36e11c898f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:20.053174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c4bef-f67c-4c27-afdc-2233b990a551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:20.054349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4bef-f67c-4c27-afdc-2233b990a551 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:20.055371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4bef-f67c-4c27-afdc-2233b990a551 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:20.055870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4bef-f67c-4c27-afdc-2233b990a551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:20.075537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c4bef-f67c-4c27-afdc-2233b990a551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:20.080474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c4bef-f67c-4c27-afdc-2233b990a551 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:20.096669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1073/2133] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:34:20.705910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f68d-8f65-4cc5-a68b-f1c7bc755426 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:20.708484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7695f68d-8f65-4cc5-a68b-f1c7bc755426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:20.741855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c4bef-f67c-4c27-afdc-2233b990a551 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:20.748618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-061c4bef-f67c-4c27-afdc-2233b990a551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:21.019863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f68d-8f65-4cc5-a68b-f1c7bc755426 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:21.040297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:21.041346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:21.041824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:21.042305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] PATH_INFO: `/v3/users/1016859f781047059d56946374b1719c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:21.045902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1016859f781047059d56946374b1719c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:21.055326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:21.058682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c4bef-f67c-4c27-afdc-2233b990a551 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:21.090806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:21.092602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:21.095258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:21.095937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] PATH_INFO: `/v3/projects/509399e0bb1c448d89bfc0e13a1d5613` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:21.114724 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509399e0bb1c448d89bfc0e13a1d5613)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:21.121049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:21.242502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1016859f781047059d56946374b1719c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.243972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1016859f781047059d56946374b1719c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.244984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1016859f781047059d56946374b1719c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.296657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1016859f781047059d56946374b1719c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.310609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:21.314527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd4cb61f-8b08-4034-9bf9-d26cba237861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1016859f781047059d56946374b1719c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.369340 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1061/2134] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:20 2022] DELETE /identity/v3/users/1016859f781047059d56946374b1719c => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:21.375974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362a186-ca6d-4a63-849a-74feb1310c5f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:21.376668 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362a186-ca6d-4a63-849a-74feb1310c5f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:21.376945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362a186-ca6d-4a63-849a-74feb1310c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:21.448587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509399e0bb1c448d89bfc0e13a1d5613', 'request_id': 'req-98fdace8-d487-43cc-930c-b0e56af2cd49'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.466475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2362a186-ca6d-4a63-849a-74feb1310c5f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:21.467343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509399e0bb1c448d89bfc0e13a1d5613', 'request_id': 'req-98fdace8-d487-43cc-930c-b0e56af2cd49'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.468124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2362a186-ca6d-4a63-849a-74feb1310c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:21.483763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509399e0bb1c448d89bfc0e13a1d5613', 'request_id': 'req-98fdace8-d487-43cc-930c-b0e56af2cd49'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.489802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:21.525765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] The token cache is being invalidate because project 509399e0bb1c448d89bfc0e13a1d5613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:21.526063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.535242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-98fdace8-d487-43cc-930c-b0e56af2cd49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:21.541185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1074/2135] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:20 2022] DELETE /identity/v3/projects/509399e0bb1c448d89bfc0e13a1d5613 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:21.552164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111acc49-593d-4bbb-8405-0d332ced8218 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:21.552712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111acc49-593d-4bbb-8405-0d332ced8218 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:21.553087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111acc49-593d-4bbb-8405-0d332ced8218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:21.607023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-111acc49-593d-4bbb-8405-0d332ced8218 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:21.609278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-111acc49-593d-4bbb-8405-0d332ced8218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:21.611519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1062/2136] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:21.645935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362a186-ca6d-4a63-849a-74feb1310c5f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:21.652781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2362a186-ca6d-4a63-849a-74feb1310c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:21.653811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1075/2137] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:21.660216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea31fde-a81b-4257-8813-2912b0be4032 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:21.662003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea31fde-a81b-4257-8813-2912b0be4032 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:21.662003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea31fde-a81b-4257-8813-2912b0be4032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:21.712023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8ea31fde-a81b-4257-8813-2912b0be4032 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:21.715624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8ea31fde-a81b-4257-8813-2912b0be4032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:21.742565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1076/2138] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:21.748418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea31fde-a81b-4257-8813-2912b0be4032 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:21.761264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea31fde-a81b-4257-8813-2912b0be4032 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:21.767991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b97bc5-ae16-48b7-93a5-374bfc75fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:21.768464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b97bc5-ae16-48b7-93a5-374bfc75fbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:21.768832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b97bc5-ae16-48b7-93a5-374bfc75fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:21.769274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b97bc5-ae16-48b7-93a5-374bfc75fbf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:21.770324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b97bc5-ae16-48b7-93a5-374bfc75fbf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:34:21.770816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b97bc5-ae16-48b7-93a5-374bfc75fbf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:21.773858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b97bc5-ae16-48b7-93a5-374bfc75fbf0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:21.786692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362a186-ca6d-4a63-849a-74feb1310c5f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:21.796819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1077/2139] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:34:21.797931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204af2e-9632-4d23-9cb3-709b03442f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:21.798577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204af2e-9632-4d23-9cb3-709b03442f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:21.798939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204af2e-9632-4d23-9cb3-709b03442f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:21.799216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204af2e-9632-4d23-9cb3-709b03442f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:21.804096 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b97bc5-ae16-48b7-93a5-374bfc75fbf0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:21.818149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b97bc5-ae16-48b7-93a5-374bfc75fbf0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:21.825376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204af2e-9632-4d23-9cb3-709b03442f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:21.827430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204af2e-9632-4d23-9cb3-709b03442f95 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:21.832407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296e9dd-ba22-40d9-88ea-22bd432a6cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:21.833395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e9dd-ba22-40d9-88ea-22bd432a6cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:21.836993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e9dd-ba22-40d9-88ea-22bd432a6cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:21.837661 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e9dd-ba22-40d9-88ea-22bd432a6cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:21.838617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296e9dd-ba22-40d9-88ea-22bd432a6cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:21.841347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296e9dd-ba22-40d9-88ea-22bd432a6cc8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:21.856910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1063/2140] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:21.899374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1078/2141] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:21 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:21.905695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204af2e-9632-4d23-9cb3-709b03442f95 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:21.965083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204af2e-9632-4d23-9cb3-709b03442f95 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:22.145104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1b28-d621-4200-aeeb-4a52c944a5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:22.146892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1b28-d621-4200-aeeb-4a52c944a5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:22.147255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1b28-d621-4200-aeeb-4a52c944a5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:22.147720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1b28-d621-4200-aeeb-4a52c944a5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:22.148960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c1b28-d621-4200-aeeb-4a52c944a5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:22.153535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c1b28-d621-4200-aeeb-4a52c944a5c7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:22.216875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1064/2142] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:21 2022] POST /identity/v3/users => generated 285 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:22.219660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296e9dd-ba22-40d9-88ea-22bd432a6cc8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:22.274329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296e9dd-ba22-40d9-88ea-22bd432a6cc8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:22.292464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e0aa3-ef26-4a15-8d0e-fdddedfa28f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:22.295599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e0aa3-ef26-4a15-8d0e-fdddedfa28f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:22.297406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e0aa3-ef26-4a15-8d0e-fdddedfa28f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:22.303078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e0aa3-ef26-4a15-8d0e-fdddedfa28f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:22.305497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e0aa3-ef26-4a15-8d0e-fdddedfa28f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:22.310510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e0aa3-ef26-4a15-8d0e-fdddedfa28f8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:22.366442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1079/2143] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:22.371195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1b28-d621-4200-aeeb-4a52c944a5c7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:22.419886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1b28-d621-4200-aeeb-4a52c944a5c7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:22.438295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0967ba-bf17-4220-822a-5b4e9d3bfd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:22.439481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0967ba-bf17-4220-822a-5b4e9d3bfd35 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:22.439994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0967ba-bf17-4220-822a-5b4e9d3bfd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:22.440964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0967ba-bf17-4220-822a-5b4e9d3bfd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:22.441956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0967ba-bf17-4220-822a-5b4e9d3bfd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:22.445341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0967ba-bf17-4220-822a-5b4e9d3bfd35 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:22.488325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1065/2144] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:34:22.502151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e0aa3-ef26-4a15-8d0e-fdddedfa28f8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:22.530483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e0aa3-ef26-4a15-8d0e-fdddedfa28f8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:22.541646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b81ca-c5ca-47e7-911a-24d3f600b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:22.543407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b81ca-c5ca-47e7-911a-24d3f600b8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:22.543686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b81ca-c5ca-47e7-911a-24d3f600b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:22.548047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b81ca-c5ca-47e7-911a-24d3f600b8cb admin admin] PATH_INFO: `/v3/projects/633bd71795fa4853a608cb80a2d552e4/users/c8f134e0af4f4a7792dd4d15d966105b/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:22.609449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b81ca-c5ca-47e7-911a-24d3f600b8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=633bd71795fa4853a608cb80a2d552e4, user_id=c8f134e0af4f4a7792dd4d15d966105b, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:22.615651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b81ca-c5ca-47e7-911a-24d3f600b8cb admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:22.648912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1080/2145] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:22 2022] PUT /identity/v3/projects/633bd71795fa4853a608cb80a2d552e4/users/c8f134e0af4f4a7792dd4d15d966105b/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:22.669523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0874f-e535-40d5-8ad5-225105155ac7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:22.670012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0874f-e535-40d5-8ad5-225105155ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:22.670490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0874f-e535-40d5-8ad5-225105155ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:22.715803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:22.749914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-13c0874f-e535-40d5-8ad5-225105155ac7 None None] MFA Rules not processed for user `c8f134e0af4f4a7792dd4d15d966105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:22.752410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-13c0874f-e535-40d5-8ad5-225105155ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:22.931454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1066/2146] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:22.953846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b81ca-c5ca-47e7-911a-24d3f600b8cb admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:22.958980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-704b81ca-c5ca-47e7-911a-24d3f600b8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:23.110595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a7210-b9ec-4e36-a250-885399ee5375 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:23.111389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a7210-b9ec-4e36-a250-885399ee5375 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:23.111988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a7210-b9ec-4e36-a250-885399ee5375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:23.179899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4d3a7210-b9ec-4e36-a250-885399ee5375 None None] MFA Rules not processed for user `3d824b7cad264484bde1071e4e6306ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:23.182894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4d3a7210-b9ec-4e36-a250-885399ee5375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:23.192881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b81ca-c5ca-47e7-911a-24d3f600b8cb admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:23.224883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5795493-860d-4a3f-9951-d3d92e5afdbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c0b33c2c7947c59ebf8da17abbd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:23.226480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795493-860d-4a3f-9951-d3d92e5afdbe service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:23.227247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795493-860d-4a3f-9951-d3d92e5afdbe service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:23.227982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795493-860d-4a3f-9951-d3d92e5afdbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:23.262828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5795493-860d-4a3f-9951-d3d92e5afdbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:23.266002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5795493-860d-4a3f-9951-d3d92e5afdbe service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:23.305933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1081/2147] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:23.365150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1067/2148] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:34:23.404456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5795493-860d-4a3f-9951-d3d92e5afdbe service glance] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:23.409982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f5795493-860d-4a3f-9951-d3d92e5afdbe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:23.765259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5795493-860d-4a3f-9951-d3d92e5afdbe service glance] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:23.780030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:23.780752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:23.781077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:23.781275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] PATH_INFO: `/v3/projects/e2bf5cd3758a4788a4e59e4e25cb8fe7` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:23.783560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2bf5cd3758a4788a4e59e4e25cb8fe7)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:23.786489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:23.822366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:23.915605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2bf5cd3758a4788a4e59e4e25cb8fe7', 'request_id': 'req-03d504df-0f94-4e5c-92f8-d369ae02834c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:23.949976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2bf5cd3758a4788a4e59e4e25cb8fe7', 'request_id': 'req-03d504df-0f94-4e5c-92f8-d369ae02834c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:23.960817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2bf5cd3758a4788a4e59e4e25cb8fe7', 'request_id': 'req-03d504df-0f94-4e5c-92f8-d369ae02834c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:23.994868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8689d8-dd6d-4a2d-a97b-72f2daa2dea0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:23.995716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8689d8-dd6d-4a2d-a97b-72f2daa2dea0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:23.996130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8689d8-dd6d-4a2d-a97b-72f2daa2dea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:24.006883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] The token cache is being invalidate because project e2bf5cd3758a4788a4e59e4e25cb8fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:24.007649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:24.009011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:24.015220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1082/2149] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:23 2022] DELETE /identity/v3/projects/e2bf5cd3758a4788a4e59e4e25cb8fe7 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:24.023656 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:24.026567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:24.079393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-da8689d8-dd6d-4a2d-a97b-72f2daa2dea0 None None] MFA Rules not processed for user `ae4f7f8855b5445d863a825ce921c982`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:24.080882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-da8689d8-dd6d-4a2d-a97b-72f2daa2dea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:24.223306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d504df-0f94-4e5c-92f8-d369ae02834c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:24.234503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:24.235809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:24.236272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:24.237760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] PATH_INFO: `/v3/users/0af34095ded34851ab14c6cf33aafad5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:24.241453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af34095ded34851ab14c6cf33aafad5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:24.255643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:24.302931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1068/2150] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:34:24.322483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05583-d0fc-441d-93d5-a8712a3a04af None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:24.323291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05583-d0fc-441d-93d5-a8712a3a04af None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:24.324714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05583-d0fc-441d-93d5-a8712a3a04af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:24.382094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-caa05583-d0fc-441d-93d5-a8712a3a04af None None] MFA Rules not processed for user `ae4f7f8855b5445d863a825ce921c982`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:24.385840 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-caa05583-d0fc-441d-93d5-a8712a3a04af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:24.401173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1069/2151] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:24.437680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05583-d0fc-441d-93d5-a8712a3a04af None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:24.446208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-caa05583-d0fc-441d-93d5-a8712a3a04af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:24.473458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af34095ded34851ab14c6cf33aafad5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:24.475658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af34095ded34851ab14c6cf33aafad5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:24.515038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af34095ded34851ab14c6cf33aafad5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:24.533030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af34095ded34851ab14c6cf33aafad5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:24.550449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af34095ded34851ab14c6cf33aafad5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:24.558638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:24.564454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1083/2152] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:24 2022] DELETE /identity/v3/users/0af34095ded34851ab14c6cf33aafad5 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:24.766725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05583-d0fc-441d-93d5-a8712a3a04af None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:25.080135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ffbc-27e5-4020-861d-f8b997201ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:25.082324 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ffbc-27e5-4020-861d-f8b997201ae7 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:25.082972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ffbc-27e5-4020-861d-f8b997201ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:25.083562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ffbc-27e5-4020-861d-f8b997201ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:25.089565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2234ffbc-27e5-4020-861d-f8b997201ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:25.423553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ffbc-27e5-4020-861d-f8b997201ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:25.426698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ffbc-27e5-4020-861d-f8b997201ae7 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:25.462598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1070/2153] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 1030 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:25.642026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:25.647024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:25.761185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:25.963039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58369e22-cd37-4839-b74f-75574c7658af admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:25.974022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:25.975547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:25.976798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:25.977414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] PATH_INFO: `/v3/projects/02c00d7948f543358401743ab45b92ad` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:25.980595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c00d7948f543358401743ab45b92ad)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:25.985061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:26.153814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c00d7948f543358401743ab45b92ad', 'request_id': 'req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.180640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c00d7948f543358401743ab45b92ad', 'request_id': 'req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.192373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c00d7948f543358401743ab45b92ad', 'request_id': 'req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.215057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] The token cache is being invalidate because project 02c00d7948f543358401743ab45b92ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:26.215337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.216065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-169a8fc9-c888-4a9b-80a0-59cb38f14bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.221155 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1084/2154] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:25 2022] DELETE /identity/v3/projects/02c00d7948f543358401743ab45b92ad => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:26.222902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ffbc-27e5-4020-861d-f8b997201ae7 service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:26.249168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ffbc-27e5-4020-861d-f8b997201ae7 service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:26.398274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:26.399000 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:26.399283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:26.399656 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] PATH_INFO: `/v3/users/1ca48d788251406dbd773deb1b205b48` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:26.401312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca48d788251406dbd773deb1b205b48)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:26.404489 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:26.412226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:26.607330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca48d788251406dbd773deb1b205b48'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.612575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca48d788251406dbd773deb1b205b48'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.616678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca48d788251406dbd773deb1b205b48'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.676361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca48d788251406dbd773deb1b205b48'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.708406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca48d788251406dbd773deb1b205b48'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:26.749697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1071/2155] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:26 2022] DELETE /identity/v3/users/1ca48d788251406dbd773deb1b205b48 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:27.563557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564a510-7b42-4132-a6ff-844eb4deef98 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:27.565289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564a510-7b42-4132-a6ff-844eb4deef98 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:27.566084 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564a510-7b42-4132-a6ff-844eb4deef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:27.672051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7564a510-7b42-4132-a6ff-844eb4deef98 None None] MFA Rules not processed for user `ae4f7f8855b5445d863a825ce921c982`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:27.674479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7564a510-7b42-4132-a6ff-844eb4deef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:27.945062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1085/2156] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:27.983973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:27.987274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:28.360779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092048-32dc-4611-a7b5-781b03727a60 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:28.401193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:28.405227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:28.407022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:28.407729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] PATH_INFO: `/v3/projects/04f8e4a3b87e4ac98ba35f2e7765f032` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:28.411862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f8e4a3b87e4ac98ba35f2e7765f032)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:28.417769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:28.586008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f8e4a3b87e4ac98ba35f2e7765f032', 'request_id': 'req-efe39664-bada-476b-bdd6-39c499fd8903'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:28.600122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f8e4a3b87e4ac98ba35f2e7765f032', 'request_id': 'req-efe39664-bada-476b-bdd6-39c499fd8903'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:28.613188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f8e4a3b87e4ac98ba35f2e7765f032', 'request_id': 'req-efe39664-bada-476b-bdd6-39c499fd8903'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:28.683701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] The token cache is being invalidate because project 04f8e4a3b87e4ac98ba35f2e7765f032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:28.684487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:28.686043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-efe39664-bada-476b-bdd6-39c499fd8903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:28.689008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1072/2157] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:27 2022] DELETE /identity/v3/projects/04f8e4a3b87e4ac98ba35f2e7765f032 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:28.699341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db1a55-d21a-4883-908d-ffe1d3eb3b5a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:28.702426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db1a55-d21a-4883-908d-ffe1d3eb3b5a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:28.703789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db1a55-d21a-4883-908d-ffe1d3eb3b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:28.817084 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c4db1a55-d21a-4883-908d-ffe1d3eb3b5a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:28.820130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c4db1a55-d21a-4883-908d-ffe1d3eb3b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:29.005526 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:29.050781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1086/2158] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:29.069625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c8e03-f9d3-462e-929f-dfa7bc9aa824 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:29.070856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c8e03-f9d3-462e-929f-dfa7bc9aa824 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:29.071376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c8e03-f9d3-462e-929f-dfa7bc9aa824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:29.129144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-892c8e03-f9d3-462e-929f-dfa7bc9aa824 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:29.136765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-892c8e03-f9d3-462e-929f-dfa7bc9aa824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:29.181867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1073/2159] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:34:29.188833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db1a55-d21a-4883-908d-ffe1d3eb3b5a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:29.230688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db1a55-d21a-4883-908d-ffe1d3eb3b5a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:29.248062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660413d9-d2a9-440a-8122-9e97a2c727c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:29.249407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660413d9-d2a9-440a-8122-9e97a2c727c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:29.250086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660413d9-d2a9-440a-8122-9e97a2c727c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:29.250831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660413d9-d2a9-440a-8122-9e97a2c727c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:29.252211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660413d9-d2a9-440a-8122-9e97a2c727c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:34:29.255046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660413d9-d2a9-440a-8122-9e97a2c727c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:29.264028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660413d9-d2a9-440a-8122-9e97a2c727c7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:29.311102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1087/2160] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:34:29.318272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c8e03-f9d3-462e-929f-dfa7bc9aa824 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:29.331191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:29.353305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c8e03-f9d3-462e-929f-dfa7bc9aa824 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:29.377191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b59047-8e3e-4c17-a5ff-a4212532da78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:29.377926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b59047-8e3e-4c17-a5ff-a4212532da78 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:29.378237 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b59047-8e3e-4c17-a5ff-a4212532da78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:29.378523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b59047-8e3e-4c17-a5ff-a4212532da78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:29.379163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b59047-8e3e-4c17-a5ff-a4212532da78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:29.381216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b59047-8e3e-4c17-a5ff-a4212532da78 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:29.451606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1074/2161] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:29 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:29.456819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660413d9-d2a9-440a-8122-9e97a2c727c7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:29.490694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660413d9-d2a9-440a-8122-9e97a2c727c7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:29.721851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b638c9-5756-480d-90e0-4fc54ee9e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:29.722723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b638c9-5756-480d-90e0-4fc54ee9e00c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:29.723323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b638c9-5756-480d-90e0-4fc54ee9e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:29.723672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b638c9-5756-480d-90e0-4fc54ee9e00c admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:29.724538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b638c9-5756-480d-90e0-4fc54ee9e00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:29.726962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b638c9-5756-480d-90e0-4fc54ee9e00c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:29.770511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1088/2162] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:29 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:29.776384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b59047-8e3e-4c17-a5ff-a4212532da78 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:29.791711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b59047-8e3e-4c17-a5ff-a4212532da78 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:29.820646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7804337-27c8-4e98-a3b7-956a6cb25b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:29.821615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804337-27c8-4e98-a3b7-956a6cb25b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:29.822059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804337-27c8-4e98-a3b7-956a6cb25b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:29.822549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804337-27c8-4e98-a3b7-956a6cb25b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:29.823454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7804337-27c8-4e98-a3b7-956a6cb25b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:29.825467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7804337-27c8-4e98-a3b7-956a6cb25b85 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:29.856736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1075/2163] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:34:29.868901 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b638c9-5756-480d-90e0-4fc54ee9e00c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:29.882909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b638c9-5756-480d-90e0-4fc54ee9e00c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:29.906616 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1449a-c1fc-43ea-8cca-9082d3bbfc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:29.908970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1449a-c1fc-43ea-8cca-9082d3bbfc66 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:29.909498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1449a-c1fc-43ea-8cca-9082d3bbfc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:29.909858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1449a-c1fc-43ea-8cca-9082d3bbfc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:29.911398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1449a-c1fc-43ea-8cca-9082d3bbfc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:29.914355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1449a-c1fc-43ea-8cca-9082d3bbfc66 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:29.955996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1089/2164] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:34:29.957368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7804337-27c8-4e98-a3b7-956a6cb25b85 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:29.987177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7804337-27c8-4e98-a3b7-956a6cb25b85 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:30.031103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9b4ce-0950-433e-bd75-6c3b25188871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:30.035527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9b4ce-0950-433e-bd75-6c3b25188871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:30.036998 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9b4ce-0950-433e-bd75-6c3b25188871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:30.038536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9b4ce-0950-433e-bd75-6c3b25188871 admin admin] PATH_INFO: `/v3/projects/f281faf04955456a88a611dd10a73a0a/users/8ad486c193e84b4ba6bd0bdaf476bc4b/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:30.083058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9b4ce-0950-433e-bd75-6c3b25188871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f281faf04955456a88a611dd10a73a0a, user_id=8ad486c193e84b4ba6bd0bdaf476bc4b, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:30.102279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9b4ce-0950-433e-bd75-6c3b25188871 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:30.146708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1076/2165] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:29 2022] PUT /identity/v3/projects/f281faf04955456a88a611dd10a73a0a/users/8ad486c193e84b4ba6bd0bdaf476bc4b/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:30.163270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57209045-3a20-4526-95b0-60ef852f8936 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:30.163714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57209045-3a20-4526-95b0-60ef852f8936 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:30.164085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57209045-3a20-4526-95b0-60ef852f8936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:30.247851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-57209045-3a20-4526-95b0-60ef852f8936 None None] MFA Rules not processed for user `8ad486c193e84b4ba6bd0bdaf476bc4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:30.251713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-57209045-3a20-4526-95b0-60ef852f8936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:30.662067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1090/2166] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:30.668966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9b4ce-0950-433e-bd75-6c3b25188871 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:30.958948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9b4ce-0950-433e-bd75-6c3b25188871 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:30.981948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4799ef-5406-4424-991e-3a0aaf73b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:30.982968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4799ef-5406-4424-991e-3a0aaf73b6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:30.983507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4799ef-5406-4424-991e-3a0aaf73b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:30.983986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4799ef-5406-4424-991e-3a0aaf73b6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:30.989625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4799ef-5406-4424-991e-3a0aaf73b6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:31.000072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4799ef-5406-4424-991e-3a0aaf73b6d9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:31.161661 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57209045-3a20-4526-95b0-60ef852f8936 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:31.165952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1077/2167] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:30 2022] POST /identity/v3/projects => generated 387 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:31.216507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57209045-3a20-4526-95b0-60ef852f8936 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:31.413683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:31.440811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de3ec1-d216-4a17-afdc-6d64444db808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:31.443353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de3ec1-d216-4a17-afdc-6d64444db808 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:31.444986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de3ec1-d216-4a17-afdc-6d64444db808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:31.445888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de3ec1-d216-4a17-afdc-6d64444db808 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:31.448914 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de3ec1-d216-4a17-afdc-6d64444db808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:31.456923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de3ec1-d216-4a17-afdc-6d64444db808 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:31.516719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1091/2168] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:31 2022] POST /identity/v3/users => generated 300 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:31.522677 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4799ef-5406-4424-991e-3a0aaf73b6d9 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:31.552658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4799ef-5406-4424-991e-3a0aaf73b6d9 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:31.588762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac293e98-761c-49af-b46d-abd67a699f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:31.590306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac293e98-761c-49af-b46d-abd67a699f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:31.595565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac293e98-761c-49af-b46d-abd67a699f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:31.596527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac293e98-761c-49af-b46d-abd67a699f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:31.607968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac293e98-761c-49af-b46d-abd67a699f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:31.614187 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac293e98-761c-49af-b46d-abd67a699f24 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:31.705235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1078/2169] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:31.712684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de3ec1-d216-4a17-afdc-6d64444db808 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:31.777968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de3ec1-d216-4a17-afdc-6d64444db808 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:31.817109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4af746-e289-4d16-a8ef-8bca5632df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:31.818755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4af746-e289-4d16-a8ef-8bca5632df8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:31.818755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4af746-e289-4d16-a8ef-8bca5632df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:31.819249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4af746-e289-4d16-a8ef-8bca5632df8b admin admin] PATH_INFO: `/v3/projects/0e8182963a8e45d294fe9141c060b941/users/699bc8ed0c154d258bbc29c5308fd7a2/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:31.983634 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4af746-e289-4d16-a8ef-8bca5632df8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8182963a8e45d294fe9141c060b941, user_id=699bc8ed0c154d258bbc29c5308fd7a2, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:32.007236 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4af746-e289-4d16-a8ef-8bca5632df8b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:32.073180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1092/2170] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:31 2022] PUT /identity/v3/projects/0e8182963a8e45d294fe9141c060b941/users/699bc8ed0c154d258bbc29c5308fd7a2/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:32.076013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac293e98-761c-49af-b46d-abd67a699f24 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:32.134754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac293e98-761c-49af-b46d-abd67a699f24 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:32.360603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0db09f-bf82-46ef-97d1-1e3f9f048c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:32.361844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0db09f-bf82-46ef-97d1-1e3f9f048c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:32.362353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0db09f-bf82-46ef-97d1-1e3f9f048c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:32.368197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0db09f-bf82-46ef-97d1-1e3f9f048c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:32.377389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0db09f-bf82-46ef-97d1-1e3f9f048c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:32.387430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0db09f-bf82-46ef-97d1-1e3f9f048c6a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:32.418140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1079/2171] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:32.423592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4af746-e289-4d16-a8ef-8bca5632df8b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:32.463298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4af746-e289-4d16-a8ef-8bca5632df8b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:32.485281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829311-8121-4025-a0ab-97b69d50e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:32.487028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829311-8121-4025-a0ab-97b69d50e793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:32.487955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829311-8121-4025-a0ab-97b69d50e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:32.494097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829311-8121-4025-a0ab-97b69d50e793 admin admin] PATH_INFO: `/v3/projects/0e8182963a8e45d294fe9141c060b941/users/699bc8ed0c154d258bbc29c5308fd7a2/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:32.512619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3829311-8121-4025-a0ab-97b69d50e793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8182963a8e45d294fe9141c060b941, user_id=699bc8ed0c154d258bbc29c5308fd7a2, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:32.518403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3829311-8121-4025-a0ab-97b69d50e793 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:32.554246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1093/2172] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:32 2022] PUT /identity/v3/projects/0e8182963a8e45d294fe9141c060b941/users/699bc8ed0c154d258bbc29c5308fd7a2/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:32.577052 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acde3b2-751b-4935-9033-1aab1bc1245e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:32.577378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acde3b2-751b-4935-9033-1aab1bc1245e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:32.577583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acde3b2-751b-4935-9033-1aab1bc1245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:32.679557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9acde3b2-751b-4935-9033-1aab1bc1245e None None] MFA Rules not processed for user `699bc8ed0c154d258bbc29c5308fd7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:32.681414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9acde3b2-751b-4935-9033-1aab1bc1245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:32.696961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:32.850011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1080/2173] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:32.877643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829311-8121-4025-a0ab-97b69d50e793 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:32.881461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a3829311-8121-4025-a0ab-97b69d50e793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:33.068148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829311-8121-4025-a0ab-97b69d50e793 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:33.074876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346534f-3f24-4047-9699-2045e9cb1577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:33.092060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346534f-3f24-4047-9699-2045e9cb1577 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:33.093820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346534f-3f24-4047-9699-2045e9cb1577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:33.095232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346534f-3f24-4047-9699-2045e9cb1577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:33.142404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346534f-3f24-4047-9699-2045e9cb1577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:33.145726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346534f-3f24-4047-9699-2045e9cb1577 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:33.182723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1094/2174] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:34.782221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acde3b2-751b-4935-9033-1aab1bc1245e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:35.015466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acde3b2-751b-4935-9033-1aab1bc1245e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:35.024876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:35.026278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:35.026619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:35.026989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] PATH_INFO: `/v3/users/8ad486c193e84b4ba6bd0bdaf476bc4b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:35.029226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad486c193e84b4ba6bd0bdaf476bc4b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:35.032884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:35.146029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad486c193e84b4ba6bd0bdaf476bc4b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:35.151527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad486c193e84b4ba6bd0bdaf476bc4b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:35.152318 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad486c193e84b4ba6bd0bdaf476bc4b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:35.172225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad486c193e84b4ba6bd0bdaf476bc4b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:35.187685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad486c193e84b4ba6bd0bdaf476bc4b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:35.219505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1081/2175] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:34 2022] DELETE /identity/v3/users/8ad486c193e84b4ba6bd0bdaf476bc4b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:35.231406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a2ca5-e07e-4fea-9c08-5fe871b5882a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:35.232228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a2ca5-e07e-4fea-9c08-5fe871b5882a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:35.232404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a2ca5-e07e-4fea-9c08-5fe871b5882a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:35.278460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1d2a2ca5-e07e-4fea-9c08-5fe871b5882a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:35.279764 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1d2a2ca5-e07e-4fea-9c08-5fe871b5882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:35.398889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1095/2176] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:35.417958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:35.420597 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:35.467120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:35.589540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e417150-0014-457a-9eae-457ea7927e66 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:35.600723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556830-94a0-4ed0-aaac-3012297c6b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:35.610220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556830-94a0-4ed0-aaac-3012297c6b99 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:35.611184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556830-94a0-4ed0-aaac-3012297c6b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:35.611948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556830-94a0-4ed0-aaac-3012297c6b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:35.644960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc556830-94a0-4ed0-aaac-3012297c6b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:35.648016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc556830-94a0-4ed0-aaac-3012297c6b99 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:35.672075 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1082/2177] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:36.336643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a2ca5-e07e-4fea-9c08-5fe871b5882a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:36.339050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1d2a2ca5-e07e-4fea-9c08-5fe871b5882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:36.365248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a2ca5-e07e-4fea-9c08-5fe871b5882a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:36.374209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:36.375069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:36.375283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:36.375964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] PATH_INFO: `/v3/projects/f281faf04955456a88a611dd10a73a0a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:36.379399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f281faf04955456a88a611dd10a73a0a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:36.382698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:36.464857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:36.481706 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f281faf04955456a88a611dd10a73a0a', 'request_id': 'req-e7197c7f-a3cd-478d-ae96-b1504e34d17d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.502576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f281faf04955456a88a611dd10a73a0a', 'request_id': 'req-e7197c7f-a3cd-478d-ae96-b1504e34d17d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.511639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f281faf04955456a88a611dd10a73a0a', 'request_id': 'req-e7197c7f-a3cd-478d-ae96-b1504e34d17d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.530392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] The token cache is being invalidate because project f281faf04955456a88a611dd10a73a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:36.530953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.531979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.534714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1096/2178] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:36 2022] DELETE /identity/v3/projects/f281faf04955456a88a611dd10a73a0a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:36.541016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556830-94a0-4ed0-aaac-3012297c6b99 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:36.561234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556830-94a0-4ed0-aaac-3012297c6b99 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:36.668985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:36.669940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:36.670365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:36.670823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] PATH_INFO: `/v3/users/699bc8ed0c154d258bbc29c5308fd7a2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:36.672735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] RBAC: Authorizing `identity:delete_user(user_id=699bc8ed0c154d258bbc29c5308fd7a2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:36.676310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:36.754477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699bc8ed0c154d258bbc29c5308fd7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.755293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699bc8ed0c154d258bbc29c5308fd7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.756075 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699bc8ed0c154d258bbc29c5308fd7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.779449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699bc8ed0c154d258bbc29c5308fd7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.792229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b6b8abf0-d587-4338-af62-0801c15b768c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699bc8ed0c154d258bbc29c5308fd7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:36.813211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1083/2179] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:36 2022] DELETE /identity/v3/users/699bc8ed0c154d258bbc29c5308fd7a2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:37.303626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:37.306982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:37.340882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7197c7f-a3cd-478d-ae96-b1504e34d17d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:37.460098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:37.461056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:37.461477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:37.461879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] PATH_INFO: `/v3/projects/0e8182963a8e45d294fe9141c060b941` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:37.463876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8182963a8e45d294fe9141c060b941)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:37.467282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:37.546165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8182963a8e45d294fe9141c060b941', 'request_id': 'req-f32904e6-a8d0-4819-9706-706fc3b16838'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:37.565660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8182963a8e45d294fe9141c060b941', 'request_id': 'req-f32904e6-a8d0-4819-9706-706fc3b16838'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:37.580251 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8182963a8e45d294fe9141c060b941', 'request_id': 'req-f32904e6-a8d0-4819-9706-706fc3b16838'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:37.617026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] The token cache is being invalidate because project 0e8182963a8e45d294fe9141c060b941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:37.617608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:37.620152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f32904e6-a8d0-4819-9706-706fc3b16838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:37.624108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1097/2180] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:37 2022] DELETE /identity/v3/projects/0e8182963a8e45d294fe9141c060b941 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:37.631486 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d2c1b-8c60-44dc-b409-0451aef7bf8c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:37.632336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d2c1b-8c60-44dc-b409-0451aef7bf8c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:37.632491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d2c1b-8c60-44dc-b409-0451aef7bf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:37.675752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a12d2c1b-8c60-44dc-b409-0451aef7bf8c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:37.679260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a12d2c1b-8c60-44dc-b409-0451aef7bf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:37.801422 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:37.858421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1084/2181] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:37.868030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca837226-964a-4766-ae06-aa4fb93bcb7e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:37.868320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca837226-964a-4766-ae06-aa4fb93bcb7e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:37.868582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca837226-964a-4766-ae06-aa4fb93bcb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:37.907501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ca837226-964a-4766-ae06-aa4fb93bcb7e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:37.910004 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ca837226-964a-4766-ae06-aa4fb93bcb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:37.930743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1098/2182] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:34:37.947539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d2c1b-8c60-44dc-b409-0451aef7bf8c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:37.960155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d2c1b-8c60-44dc-b409-0451aef7bf8c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:37.969880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943bef1-9321-46fd-939e-17f930519b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:37.971468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943bef1-9321-46fd-939e-17f930519b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:37.972508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943bef1-9321-46fd-939e-17f930519b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:37.973254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943bef1-9321-46fd-939e-17f930519b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:37.974790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943bef1-9321-46fd-939e-17f930519b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:34:37.975648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943bef1-9321-46fd-939e-17f930519b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:37.980178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943bef1-9321-46fd-939e-17f930519b75 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:38.018712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1085/2183] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:34:38.022224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca837226-964a-4766-ae06-aa4fb93bcb7e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:38.039787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca837226-964a-4766-ae06-aa4fb93bcb7e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:38.049365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d8126-354d-40a2-9338-64090079ab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:38.050825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d8126-354d-40a2-9338-64090079ab24 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:38.051563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d8126-354d-40a2-9338-64090079ab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:38.052228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d8126-354d-40a2-9338-64090079ab24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:38.053738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d8126-354d-40a2-9338-64090079ab24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:38.057446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d8126-354d-40a2-9338-64090079ab24 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:38.139672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1099/2184] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:38 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:38.141122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943bef1-9321-46fd-939e-17f930519b75 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:38.155212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943bef1-9321-46fd-939e-17f930519b75 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:38.261753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81517898-4f73-4685-a677-53f840c05c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:38.262492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81517898-4f73-4685-a677-53f840c05c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:38.262947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81517898-4f73-4685-a677-53f840c05c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:38.263269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81517898-4f73-4685-a677-53f840c05c69 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:38.264005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81517898-4f73-4685-a677-53f840c05c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:38.266195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81517898-4f73-4685-a677-53f840c05c69 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:38.309056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1086/2185] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:38 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:38.317104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d8126-354d-40a2-9338-64090079ab24 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:38.336247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81517898-4f73-4685-a677-53f840c05c69 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:38.338530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-81517898-4f73-4685-a677-53f840c05c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:38.344886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d8126-354d-40a2-9338-64090079ab24 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:38.356896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e131f0-c9a5-4acd-8922-3227b41c6ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:38.358311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e131f0-c9a5-4acd-8922-3227b41c6ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:38.359583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e131f0-c9a5-4acd-8922-3227b41c6ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:38.360730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e131f0-c9a5-4acd-8922-3227b41c6ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:38.362483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e131f0-c9a5-4acd-8922-3227b41c6ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:38.365986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e131f0-c9a5-4acd-8922-3227b41c6ffa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:38.372821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81517898-4f73-4685-a677-53f840c05c69 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:38.380009 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:38.380929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:38.381309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:38.381866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] PATH_INFO: `/v3/users/aa4183d548384aec82f49656ea9eee8c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:38.383536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4183d548384aec82f49656ea9eee8c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:38.386515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:38.392799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1100/2186] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:38.399899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e131f0-c9a5-4acd-8922-3227b41c6ffa admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:38.427785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e131f0-c9a5-4acd-8922-3227b41c6ffa admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:38.447200 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc8901-0448-4762-ae62-ddf27ebb17ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:38.448361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc8901-0448-4762-ae62-ddf27ebb17ed admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:38.448752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc8901-0448-4762-ae62-ddf27ebb17ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:38.449151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc8901-0448-4762-ae62-ddf27ebb17ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:38.450232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc8901-0448-4762-ae62-ddf27ebb17ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:38.453265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc8901-0448-4762-ae62-ddf27ebb17ed admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:38.475697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1101/2187] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:38.482947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc8901-0448-4762-ae62-ddf27ebb17ed admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:38.493150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4183d548384aec82f49656ea9eee8c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:38.494519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4183d548384aec82f49656ea9eee8c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:38.496079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4183d548384aec82f49656ea9eee8c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:38.517517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc8901-0448-4762-ae62-ddf27ebb17ed admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:38.537130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b6bfe-fd3b-44e0-aa73-ff1d4c8a16ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:38.540394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4183d548384aec82f49656ea9eee8c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:38.542008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b6bfe-fd3b-44e0-aa73-ff1d4c8a16ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:38.545207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b6bfe-fd3b-44e0-aa73-ff1d4c8a16ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:38.546490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b6bfe-fd3b-44e0-aa73-ff1d4c8a16ff admin admin] PATH_INFO: `/v3/projects/f5cd5a7f788446b99a44e0891d1fe6a8/users/1ad770c5ae67430f93ad8d9da6cf00e5/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:38.563520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:38.578633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0e10ec47-feab-496b-962c-e8b5ba699be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4183d548384aec82f49656ea9eee8c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:38.625182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b6bfe-fd3b-44e0-aa73-ff1d4c8a16ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cd5a7f788446b99a44e0891d1fe6a8, user_id=1ad770c5ae67430f93ad8d9da6cf00e5, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:38.633044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1087/2188] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:38 2022] DELETE /identity/v3/users/aa4183d548384aec82f49656ea9eee8c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:38.644275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82b1f9-e236-461d-bcc1-44f031615f66 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:38.644592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b6bfe-fd3b-44e0-aa73-ff1d4c8a16ff admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:38.644810 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82b1f9-e236-461d-bcc1-44f031615f66 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:38.645200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82b1f9-e236-461d-bcc1-44f031615f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:38.675003 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1102/2189] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:38 2022] PUT /identity/v3/projects/f5cd5a7f788446b99a44e0891d1fe6a8/users/1ad770c5ae67430f93ad8d9da6cf00e5/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:38.697431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da3f7b-158f-430f-836a-b8a030bd5fac None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:38.697733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da3f7b-158f-430f-836a-b8a030bd5fac None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:38.698049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da3f7b-158f-430f-836a-b8a030bd5fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:38.708912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-eb82b1f9-e236-461d-bcc1-44f031615f66 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:38.711099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-eb82b1f9-e236-461d-bcc1-44f031615f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:38.748576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a6da3f7b-158f-430f-836a-b8a030bd5fac None None] MFA Rules not processed for user `1ad770c5ae67430f93ad8d9da6cf00e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:38.750694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a6da3f7b-158f-430f-836a-b8a030bd5fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:38.827381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:38.877564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1103/2190] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:38.884100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da3f7b-158f-430f-836a-b8a030bd5fac None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:38.885944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a6da3f7b-158f-430f-836a-b8a030bd5fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:38.917417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1088/2191] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:34:38.962475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82b1f9-e236-461d-bcc1-44f031615f66 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:38.967813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-eb82b1f9-e236-461d-bcc1-44f031615f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:39.053298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da3f7b-158f-430f-836a-b8a030bd5fac None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:39.062851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e43ad-ad01-4a08-a4be-efbe491386f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:39.064167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e43ad-ad01-4a08-a4be-efbe491386f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:39.064642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e43ad-ad01-4a08-a4be-efbe491386f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:39.065115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e43ad-ad01-4a08-a4be-efbe491386f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:39.066317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e43ad-ad01-4a08-a4be-efbe491386f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:39.071756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e43ad-ad01-4a08-a4be-efbe491386f0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:39.132840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1104/2192] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:38 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:39.137744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e43ad-ad01-4a08-a4be-efbe491386f0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:39.153176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82b1f9-e236-461d-bcc1-44f031615f66 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:39.275377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b8dba-0047-49a4-8327-aa9d9a9c8639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:39.275834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b8dba-0047-49a4-8327-aa9d9a9c8639 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:39.276272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e43ad-ad01-4a08-a4be-efbe491386f0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:39.276437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b8dba-0047-49a4-8327-aa9d9a9c8639 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:39.276673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b8dba-0047-49a4-8327-aa9d9a9c8639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:39.287405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c95f6c-64bf-4913-9631-e75f103a0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:39.288646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c95f6c-64bf-4913-9631-e75f103a0b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:39.289124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c95f6c-64bf-4913-9631-e75f103a0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:39.289590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c95f6c-64bf-4913-9631-e75f103a0b4e admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:39.290850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c95f6c-64bf-4913-9631-e75f103a0b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:39.294907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c95f6c-64bf-4913-9631-e75f103a0b4e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:39.304061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b8dba-0047-49a4-8327-aa9d9a9c8639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:39.307093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b8dba-0047-49a4-8327-aa9d9a9c8639 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:39.309559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:39.330153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1089/2193] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:39.337454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1105/2194] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:39 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:34:39.344067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b8dba-0047-49a4-8327-aa9d9a9c8639 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:39.364798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b8dba-0047-49a4-8327-aa9d9a9c8639 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:39.371774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ed02f-5251-4029-a66f-0703bcbc973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:39.372599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ed02f-5251-4029-a66f-0703bcbc973d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:39.373158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ed02f-5251-4029-a66f-0703bcbc973d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:39.373560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ed02f-5251-4029-a66f-0703bcbc973d admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:39.374689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ed02f-5251-4029-a66f-0703bcbc973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:39.378631 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ed02f-5251-4029-a66f-0703bcbc973d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:39.396982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1090/2195] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:39.404037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c95f6c-64bf-4913-9631-e75f103a0b4e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:39.426501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c95f6c-64bf-4913-9631-e75f103a0b4e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:39.435853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc6c52-a0e6-46fb-8fd4-46b88fae1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:39.436957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc6c52-a0e6-46fb-8fd4-46b88fae1e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:39.437671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc6c52-a0e6-46fb-8fd4-46b88fae1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:39.438383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc6c52-a0e6-46fb-8fd4-46b88fae1e03 admin admin] PATH_INFO: `/v3/projects/0a7ec7eb73504152b019deb4322b5334/users/629177dd9bc84f32bfa895539ec4a9f9/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:39.469792 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc6c52-a0e6-46fb-8fd4-46b88fae1e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7ec7eb73504152b019deb4322b5334, user_id=629177dd9bc84f32bfa895539ec4a9f9, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:39.476712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc6c52-a0e6-46fb-8fd4-46b88fae1e03 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:39.504737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1106/2196] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:39 2022] PUT /identity/v3/projects/0a7ec7eb73504152b019deb4322b5334/users/629177dd9bc84f32bfa895539ec4a9f9/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:39.508925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ed02f-5251-4029-a66f-0703bcbc973d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:39.534090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ed02f-5251-4029-a66f-0703bcbc973d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:39.661012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98350e-ca10-424b-8bed-8513fc54688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:39.662082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98350e-ca10-424b-8bed-8513fc54688d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:39.662586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98350e-ca10-424b-8bed-8513fc54688d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:39.663172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98350e-ca10-424b-8bed-8513fc54688d admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:39.665622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98350e-ca10-424b-8bed-8513fc54688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:39.668493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98350e-ca10-424b-8bed-8513fc54688d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:39.693712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1091/2197] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:39.700321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc6c52-a0e6-46fb-8fd4-46b88fae1e03 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:39.715258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc6c52-a0e6-46fb-8fd4-46b88fae1e03 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:39.722088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8395b-26bf-4bbd-a162-dfdc6da833f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:39.722925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8395b-26bf-4bbd-a162-dfdc6da833f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:39.723319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8395b-26bf-4bbd-a162-dfdc6da833f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:39.723702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8395b-26bf-4bbd-a162-dfdc6da833f1 admin admin] PATH_INFO: `/v3/projects/0a7ec7eb73504152b019deb4322b5334/users/629177dd9bc84f32bfa895539ec4a9f9/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:39.726449 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8395b-26bf-4bbd-a162-dfdc6da833f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7ec7eb73504152b019deb4322b5334, user_id=629177dd9bc84f32bfa895539ec4a9f9, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:39.730507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8395b-26bf-4bbd-a162-dfdc6da833f1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:39.758687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1107/2198] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:39 2022] PUT /identity/v3/projects/0a7ec7eb73504152b019deb4322b5334/users/629177dd9bc84f32bfa895539ec4a9f9/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:39.767030 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f5ade-7e77-445f-a3ba-03766e87e940 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:39.767495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f5ade-7e77-445f-a3ba-03766e87e940 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:39.768425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f5ade-7e77-445f-a3ba-03766e87e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:39.857780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bc2f5ade-7e77-445f-a3ba-03766e87e940 None None] MFA Rules not processed for user `629177dd9bc84f32bfa895539ec4a9f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:39.860702 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bc2f5ade-7e77-445f-a3ba-03766e87e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:39.872048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:40.047327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1092/2199] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:34:40.055473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8395b-26bf-4bbd-a162-dfdc6da833f1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:40.058310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6fd8395b-26bf-4bbd-a162-dfdc6da833f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:40.195277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8395b-26bf-4bbd-a162-dfdc6da833f1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:40.201297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bded2-acf8-4b73-9a48-8b6495c96bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:40.202115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bded2-acf8-4b73-9a48-8b6495c96bcf service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:40.202493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bded2-acf8-4b73-9a48-8b6495c96bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:40.202908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bded2-acf8-4b73-9a48-8b6495c96bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:40.218607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bded2-acf8-4b73-9a48-8b6495c96bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:40.223436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bded2-acf8-4b73-9a48-8b6495c96bcf service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:40.258399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1108/2200] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:40.701070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f5ade-7e77-445f-a3ba-03766e87e940 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:40.704172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bc2f5ade-7e77-445f-a3ba-03766e87e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:40.819681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f5ade-7e77-445f-a3ba-03766e87e940 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:40.827426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:40.829144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:40.829144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:40.829555 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] PATH_INFO: `/v3/projects/617398ec060345fd8d0aeb5479f02ad8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:40.832815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=617398ec060345fd8d0aeb5479f02ad8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:40.835738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:40.942203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617398ec060345fd8d0aeb5479f02ad8', 'request_id': 'req-f911235a-4470-46ec-ab37-26313154d576'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:40.961718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617398ec060345fd8d0aeb5479f02ad8', 'request_id': 'req-f911235a-4470-46ec-ab37-26313154d576'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:40.980752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617398ec060345fd8d0aeb5479f02ad8', 'request_id': 'req-f911235a-4470-46ec-ab37-26313154d576'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:41.002575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] The token cache is being invalidate because project 617398ec060345fd8d0aeb5479f02ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:41.002985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:41.008117 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f911235a-4470-46ec-ab37-26313154d576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:41.010227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1093/2201] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:40 2022] DELETE /identity/v3/projects/617398ec060345fd8d0aeb5479f02ad8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:41.017969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f329-0d07-4101-9a13-53088c17143c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.018849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f329-0d07-4101-9a13-53088c17143c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.019307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f329-0d07-4101-9a13-53088c17143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.054729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f619f329-0d07-4101-9a13-53088c17143c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:41.056146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f619f329-0d07-4101-9a13-53088c17143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:41.174617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1109/2202] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:41.179437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1529a-90b1-4076-8283-f821847b6490 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.179924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1529a-90b1-4076-8283-f821847b6490 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.180411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1529a-90b1-4076-8283-f821847b6490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.244859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e7d1529a-90b1-4076-8283-f821847b6490 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:41.248296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e7d1529a-90b1-4076-8283-f821847b6490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:41.271669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1094/2203] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:41.278795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f329-0d07-4101-9a13-53088c17143c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:41.292391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1529a-90b1-4076-8283-f821847b6490 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:41.294281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e7d1529a-90b1-4076-8283-f821847b6490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:41.303159 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f329-0d07-4101-9a13-53088c17143c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:41.312246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20021-98b3-4e67-9e80-fa6898ec504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:41.313291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20021-98b3-4e67-9e80-fa6898ec504e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.313744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20021-98b3-4e67-9e80-fa6898ec504e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.314403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20021-98b3-4e67-9e80-fa6898ec504e admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.315712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1529a-90b1-4076-8283-f821847b6490 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:41.316266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc20021-98b3-4e67-9e80-fa6898ec504e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:34:41.316783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc20021-98b3-4e67-9e80-fa6898ec504e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:41.320007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc20021-98b3-4e67-9e80-fa6898ec504e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:41.335512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:41.337078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.338537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.339033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] PATH_INFO: `/v3/users/1ad770c5ae67430f93ad8d9da6cf00e5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.340645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad770c5ae67430f93ad8d9da6cf00e5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:41.343588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:41.351041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1110/2204] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:34:41.357809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20021-98b3-4e67-9e80-fa6898ec504e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:41.378332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:41.381444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20021-98b3-4e67-9e80-fa6898ec504e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:41.397209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159cb9c-5310-4577-a441-a870c4b6e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:41.398438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159cb9c-5310-4577-a441-a870c4b6e4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.398959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159cb9c-5310-4577-a441-a870c4b6e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.399432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159cb9c-5310-4577-a441-a870c4b6e4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.401097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159cb9c-5310-4577-a441-a870c4b6e4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:41.405462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159cb9c-5310-4577-a441-a870c4b6e4f3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:41.425305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad770c5ae67430f93ad8d9da6cf00e5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:41.426356 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad770c5ae67430f93ad8d9da6cf00e5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:41.427411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad770c5ae67430f93ad8d9da6cf00e5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:41.447326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad770c5ae67430f93ad8d9da6cf00e5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:41.458543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1111/2205] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:34:41 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:41.461562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-50d364ec-be68-424c-87e0-8dadafbdd2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad770c5ae67430f93ad8d9da6cf00e5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:41.462013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159cb9c-5310-4577-a441-a870c4b6e4f3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:41.465173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f159cb9c-5310-4577-a441-a870c4b6e4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:41.488350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1095/2206] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:41 2022] DELETE /identity/v3/users/1ad770c5ae67430f93ad8d9da6cf00e5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:41.498753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2d5e-2ddf-4ea1-949f-dbac0be08782 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.499261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2d5e-2ddf-4ea1-949f-dbac0be08782 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.499735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2d5e-2ddf-4ea1-949f-dbac0be08782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.522862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:41.541978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5c0d2d5e-2ddf-4ea1-949f-dbac0be08782 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:41.544118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5c0d2d5e-2ddf-4ea1-949f-dbac0be08782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:41.603351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159cb9c-5310-4577-a441-a870c4b6e4f3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:41.658094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1096/2207] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:41.673879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2d5e-2ddf-4ea1-949f-dbac0be08782 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:41.677372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5c0d2d5e-2ddf-4ea1-949f-dbac0be08782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:41.709861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36783b1-a9d7-4876-afcb-84a0e2cb81fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:41.710761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36783b1-a9d7-4876-afcb-84a0e2cb81fe admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.711186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36783b1-a9d7-4876-afcb-84a0e2cb81fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.711558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36783b1-a9d7-4876-afcb-84a0e2cb81fe admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.712476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36783b1-a9d7-4876-afcb-84a0e2cb81fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:41.715840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36783b1-a9d7-4876-afcb-84a0e2cb81fe admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:41.746772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1112/2208] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:34:41 2022] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:34:41.752366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36783b1-a9d7-4876-afcb-84a0e2cb81fe admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:41.765405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36783b1-a9d7-4876-afcb-84a0e2cb81fe admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:41.771679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e3864-29b5-4fe0-9b78-1cc33fd7a1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:41.772505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e3864-29b5-4fe0-9b78-1cc33fd7a1cd admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.772879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e3864-29b5-4fe0-9b78-1cc33fd7a1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.773180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e3864-29b5-4fe0-9b78-1cc33fd7a1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.774051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e3864-29b5-4fe0-9b78-1cc33fd7a1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:41.775648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2d5e-2ddf-4ea1-949f-dbac0be08782 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:41.776556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e3864-29b5-4fe0-9b78-1cc33fd7a1cd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:41.782132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac5627-3cd6-4725-be9f-62467ea7f5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:41.783431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac5627-3cd6-4725-be9f-62467ea7f5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.784086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac5627-3cd6-4725-be9f-62467ea7f5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.784610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac5627-3cd6-4725-be9f-62467ea7f5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.803362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1113/2209] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:34:41.803639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac5627-3cd6-4725-be9f-62467ea7f5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:41.803639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac5627-3cd6-4725-be9f-62467ea7f5a0 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:41.805011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e3864-29b5-4fe0-9b78-1cc33fd7a1cd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:41.820568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e3864-29b5-4fe0-9b78-1cc33fd7a1cd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:41.821299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1097/2210] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:34:41.827499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d5367-588e-489c-b1a2-ea0bf4cc4a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:41.828217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d5367-588e-489c-b1a2-ea0bf4cc4a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.828535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d5367-588e-489c-b1a2-ea0bf4cc4a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.828850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d5367-588e-489c-b1a2-ea0bf4cc4a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.829709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d5367-588e-489c-b1a2-ea0bf4cc4a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:41.831993 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d5367-588e-489c-b1a2-ea0bf4cc4a8c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:41.846128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1114/2211] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:34:41.850914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac5627-3cd6-4725-be9f-62467ea7f5a0 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:41.865190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac5627-3cd6-4725-be9f-62467ea7f5a0 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:41.873856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62a0f7-c087-4b7b-81f4-f34777c35e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:41.875053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62a0f7-c087-4b7b-81f4-f34777c35e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.875838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62a0f7-c087-4b7b-81f4-f34777c35e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.876375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62a0f7-c087-4b7b-81f4-f34777c35e56 admin admin] PATH_INFO: `/v3/projects/727bfec133af4b0db4dd397ee32fbb2e/users/b985a376cdbd45bf80a3142ffbd81fba/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.900563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62a0f7-c087-4b7b-81f4-f34777c35e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727bfec133af4b0db4dd397ee32fbb2e, user_id=b985a376cdbd45bf80a3142ffbd81fba, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:41.905122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62a0f7-c087-4b7b-81f4-f34777c35e56 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:41.928694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1098/2212] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:34:41 2022] PUT /identity/v3/projects/727bfec133af4b0db4dd397ee32fbb2e/users/b985a376cdbd45bf80a3142ffbd81fba/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:41.937213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40188b4-1555-457f-9e71-57c76728bcc9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:41.937563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40188b4-1555-457f-9e71-57c76728bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:41.937839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40188b4-1555-457f-9e71-57c76728bcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:41.973289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f40188b4-1555-457f-9e71-57c76728bcc9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:41.976594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f40188b4-1555-457f-9e71-57c76728bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:42.081023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1115/2213] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:42.124525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62a0f7-c087-4b7b-81f4-f34777c35e56 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:42.128316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7f62a0f7-c087-4b7b-81f4-f34777c35e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:42.166881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:42.238083 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62a0f7-c087-4b7b-81f4-f34777c35e56 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:42.243008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535089d-3b74-4b89-84e2-e6682c8a896e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:42.244018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535089d-3b74-4b89-84e2-e6682c8a896e service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:42.244485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535089d-3b74-4b89-84e2-e6682c8a896e service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:42.244968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535089d-3b74-4b89-84e2-e6682c8a896e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:42.265944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535089d-3b74-4b89-84e2-e6682c8a896e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:42.268648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535089d-3b74-4b89-84e2-e6682c8a896e service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:42.283793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1099/2214] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:34:42.341049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40188b4-1555-457f-9e71-57c76728bcc9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:42.343231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f40188b4-1555-457f-9e71-57c76728bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:42.397271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40188b4-1555-457f-9e71-57c76728bcc9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:42.406108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:42.407260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:42.407692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:42.408226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] PATH_INFO: `/v3/projects/f5cd5a7f788446b99a44e0891d1fe6a8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:42.424154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cd5a7f788446b99a44e0891d1fe6a8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:42.430527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:42.513167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:42.551717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cd5a7f788446b99a44e0891d1fe6a8', 'request_id': 'req-8aa71414-c322-4221-b2de-86c426eb58e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.563329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cd5a7f788446b99a44e0891d1fe6a8', 'request_id': 'req-8aa71414-c322-4221-b2de-86c426eb58e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.572710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cd5a7f788446b99a44e0891d1fe6a8', 'request_id': 'req-8aa71414-c322-4221-b2de-86c426eb58e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.593784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] The token cache is being invalidate because project f5cd5a7f788446b99a44e0891d1fe6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:42.594311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.595197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.598637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1116/2215] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:42 2022] DELETE /identity/v3/projects/f5cd5a7f788446b99a44e0891d1fe6a8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:34:42.604701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535089d-3b74-4b89-84e2-e6682c8a896e service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:42.628137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535089d-3b74-4b89-84e2-e6682c8a896e service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:42.714687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:42.715342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:42.715617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:42.715897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] PATH_INFO: `/v3/users/629177dd9bc84f32bfa895539ec4a9f9` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:42.717164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=629177dd9bc84f32bfa895539ec4a9f9)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:42.719391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:42.802210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629177dd9bc84f32bfa895539ec4a9f9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.803284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629177dd9bc84f32bfa895539ec4a9f9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.803814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629177dd9bc84f32bfa895539ec4a9f9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.821739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629177dd9bc84f32bfa895539ec4a9f9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.832894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c2f4893-f372-405c-9dfd-7cf1ba7beb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629177dd9bc84f32bfa895539ec4a9f9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:42.851751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1100/2216] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:42 2022] DELETE /identity/v3/users/629177dd9bc84f32bfa895539ec4a9f9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:43.386008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:43.388293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:43.444781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa71414-c322-4221-b2de-86c426eb58e3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:43.532782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3363-b9cb-43ef-8751-15e71253b9b2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:43.533419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3363-b9cb-43ef-8751-15e71253b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:43.534030 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3363-b9cb-43ef-8751-15e71253b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:43.564320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:43.565432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:43.565926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:43.566566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] PATH_INFO: `/v3/projects/0a7ec7eb73504152b019deb4322b5334` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:43.568868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7ec7eb73504152b019deb4322b5334)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:43.572836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9d0c3363-b9cb-43ef-8751-15e71253b9b2 None None] MFA Rules not processed for user `b985a376cdbd45bf80a3142ffbd81fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:43.573093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:43.574172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9d0c3363-b9cb-43ef-8751-15e71253b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:43.631880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:43.708760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7ec7eb73504152b019deb4322b5334', 'request_id': 'req-daef9758-9bc0-4a99-bea3-34ad196c5152'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:43.722381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1101/2217] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:43.724924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7ec7eb73504152b019deb4322b5334', 'request_id': 'req-daef9758-9bc0-4a99-bea3-34ad196c5152'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:43.739332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7ec7eb73504152b019deb4322b5334', 'request_id': 'req-daef9758-9bc0-4a99-bea3-34ad196c5152'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:43.745011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c3363-b9cb-43ef-8751-15e71253b9b2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:43.747470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9d0c3363-b9cb-43ef-8751-15e71253b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:43.767842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] The token cache is being invalidate because project 0a7ec7eb73504152b019deb4322b5334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:43.769038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:43.770741 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-daef9758-9bc0-4a99-bea3-34ad196c5152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:43.775013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1117/2218] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:43 2022] DELETE /identity/v3/projects/0a7ec7eb73504152b019deb4322b5334 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:43.860690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c3363-b9cb-43ef-8751-15e71253b9b2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:43.957251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:43.957932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:43.958227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:43.958509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:43.961128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:44.072830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:44.075215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:44.105645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1102/2219] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:34:45.628453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba520e8-e37a-4f71-b380-0f1a1c2285b1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:45.629247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba520e8-e37a-4f71-b380-0f1a1c2285b1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:45.629247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba520e8-e37a-4f71-b380-0f1a1c2285b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:45.653588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5ba520e8-e37a-4f71-b380-0f1a1c2285b1 None None] MFA Rules not processed for user `b985a376cdbd45bf80a3142ffbd81fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:45.654929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5ba520e8-e37a-4f71-b380-0f1a1c2285b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:45.668433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1118/2220] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:34:54.087883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=82 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:55.646859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=67,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:56.261392 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:56.264420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:56.398195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae3951-f364-4dba-9177-2c6609a8234e service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:56.403873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:56.404765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:56.405188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:56.405497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] PATH_INFO: `/v3/users/c8f134e0af4f4a7792dd4d15d966105b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:56.407211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f134e0af4f4a7792dd4d15d966105b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:56.411412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:56.523712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f134e0af4f4a7792dd4d15d966105b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:56.524642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f134e0af4f4a7792dd4d15d966105b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:56.525445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f134e0af4f4a7792dd4d15d966105b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:56.567343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f134e0af4f4a7792dd4d15d966105b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:56.583901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f134e0af4f4a7792dd4d15d966105b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:56.627748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1103/2221] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:34:56 2022] DELETE /identity/v3/users/c8f134e0af4f4a7792dd4d15d966105b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:34:56.633303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672d265-6225-4238-b40e-405917ae5d17 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:56.633747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672d265-6225-4238-b40e-405917ae5d17 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:56.634340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672d265-6225-4238-b40e-405917ae5d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:56.672401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3672d265-6225-4238-b40e-405917ae5d17 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:34:56.675991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3672d265-6225-4238-b40e-405917ae5d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:56.777144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1119/2222] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:34:56.788971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:56.791297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:56.885242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc91cc-dac0-444d-a22b-4d0075bb0408 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:56.890846 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a82a2e-5b91-4dd3-89b7-2c9f865897e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:56.892743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a82a2e-5b91-4dd3-89b7-2c9f865897e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:56.893130 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a82a2e-5b91-4dd3-89b7-2c9f865897e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:56.893490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a82a2e-5b91-4dd3-89b7-2c9f865897e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:56.905984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a82a2e-5b91-4dd3-89b7-2c9f865897e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:56.909154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a82a2e-5b91-4dd3-89b7-2c9f865897e4 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:56.924986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1104/2223] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:34:57.711896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672d265-6225-4238-b40e-405917ae5d17 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:34:57.721394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3672d265-6225-4238-b40e-405917ae5d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:34:57.761603 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672d265-6225-4238-b40e-405917ae5d17 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:34:57.777371 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:34:57.778780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:34:57.779779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:34:57.780452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] PATH_INFO: `/v3/projects/633bd71795fa4853a608cb80a2d552e4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:34:57.782756 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=633bd71795fa4853a608cb80a2d552e4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:34:57.786992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:34:57.865780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633bd71795fa4853a608cb80a2d552e4', 'request_id': 'req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:57.886175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633bd71795fa4853a608cb80a2d552e4', 'request_id': 'req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:57.903745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633bd71795fa4853a608cb80a2d552e4', 'request_id': 'req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:57.927132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] The token cache is being invalidate because project 633bd71795fa4853a608cb80a2d552e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:34:57.927887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:57.930088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:34:57.933657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1120/2224] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:34:57 2022] DELETE /identity/v3/projects/633bd71795fa4853a608cb80a2d552e4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:35:01.017062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a4830-cc6a-4edb-b59f-f711ba729ec4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:01.017861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a4830-cc6a-4edb-b59f-f711ba729ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:01.018005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a4830-cc6a-4edb-b59f-f711ba729ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:01.047032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-510a4830-cc6a-4edb-b59f-f711ba729ec4 None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:35:01.049987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-510a4830-cc6a-4edb-b59f-f711ba729ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:01.079498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:01.145482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1105/2225] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:35:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:35:01.207251 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:01.208989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:01.339049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac3298-3a44-4d2a-9e36-ee6e445f7b9a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:01.348058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ddf90-4a4f-4209-b6c6-965a9d8468fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:01.349164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ddf90-4a4f-4209-b6c6-965a9d8468fa service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:01.349725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ddf90-4a4f-4209-b6c6-965a9d8468fa service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:01.350362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ddf90-4a4f-4209-b6c6-965a9d8468fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:01.372862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ddf90-4a4f-4209-b6c6-965a9d8468fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:01.376051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ddf90-4a4f-4209-b6c6-965a9d8468fa service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:01.392577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1121/2226] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:35:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:11.134480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=15 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:11.385275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:26.682482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937023bd-21ef-415f-8c2e-cbf6a78ef66a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:26.683100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937023bd-21ef-415f-8c2e-cbf6a78ef66a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:26.683100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937023bd-21ef-415f-8c2e-cbf6a78ef66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:26.714187 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-937023bd-21ef-415f-8c2e-cbf6a78ef66a None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:35:26.716409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-937023bd-21ef-415f-8c2e-cbf6a78ef66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:26.729029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1106/2227] 10.222.0.78 () {58 vars in 967 bytes} [Wed Aug 24 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:35:26.748406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ddf90-4a4f-4209-b6c6-965a9d8468fa service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:26.761241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ddf90-4a4f-4209-b6c6-965a9d8468fa service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:26.770104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629951-5f28-4ecb-b1ad-db781ac4e7a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:26.771257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629951-5f28-4ecb-b1ad-db781ac4e7a0 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:26.771731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629951-5f28-4ecb-b1ad-db781ac4e7a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:26.772215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629951-5f28-4ecb-b1ad-db781ac4e7a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:26.789222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629951-5f28-4ecb-b1ad-db781ac4e7a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:26.792236 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629951-5f28-4ecb-b1ad-db781ac4e7a0 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:26.808597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1122/2228] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:29.474250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937023bd-21ef-415f-8c2e-cbf6a78ef66a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:29.478283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-937023bd-21ef-415f-8c2e-cbf6a78ef66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:29.624698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937023bd-21ef-415f-8c2e-cbf6a78ef66a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:29.633580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:29.634515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:29.634867 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:29.635168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] PATH_INFO: `/v3/users/3d824b7cad264484bde1071e4e6306ad` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:29.638994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d824b7cad264484bde1071e4e6306ad)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:29.640817 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:29.741325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d824b7cad264484bde1071e4e6306ad'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:29.742284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d824b7cad264484bde1071e4e6306ad'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:29.743803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d824b7cad264484bde1071e4e6306ad'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:29.764028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d824b7cad264484bde1071e4e6306ad'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:29.774696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-69fb65bf-a77d-420f-9f68-e94030ac3c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d824b7cad264484bde1071e4e6306ad'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:29.807842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1107/2229] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:35:29 2022] DELETE /identity/v3/users/3d824b7cad264484bde1071e4e6306ad => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:35:30.072148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629951-5f28-4ecb-b1ad-db781ac4e7a0 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:30.087692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629951-5f28-4ecb-b1ad-db781ac4e7a0 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:30.188144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:30.189299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.189772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.190244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] PATH_INFO: `/v3/projects/30db6d523c5c4763933b86c160ea3d87` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.192510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30db6d523c5c4763933b86c160ea3d87)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:30.196330 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:30.273234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30db6d523c5c4763933b86c160ea3d87', 'request_id': 'req-0720551e-1584-4704-8e67-8f0ca8b14c46'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:30.283166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30db6d523c5c4763933b86c160ea3d87', 'request_id': 'req-0720551e-1584-4704-8e67-8f0ca8b14c46'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:30.291251 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30db6d523c5c4763933b86c160ea3d87', 'request_id': 'req-0720551e-1584-4704-8e67-8f0ca8b14c46'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:30.303862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] The token cache is being invalidate because project 30db6d523c5c4763933b86c160ea3d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:35:30.304156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:30.304857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0720551e-1584-4704-8e67-8f0ca8b14c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:35:30.306452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1123/2230] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:35:30 2022] DELETE /identity/v3/projects/30db6d523c5c4763933b86c160ea3d87 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:35:30.312316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888753a1-8dff-41b2-b677-7620840779c2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.312758 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888753a1-8dff-41b2-b677-7620840779c2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.313089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888753a1-8dff-41b2-b677-7620840779c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.339292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-888753a1-8dff-41b2-b677-7620840779c2 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:35:30.340603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-888753a1-8dff-41b2-b677-7620840779c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:30.419073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1108/2231] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:35:30.429477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aa8ad-d483-493f-8529-dae12f953bb6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.430039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aa8ad-d483-493f-8529-dae12f953bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.430487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aa8ad-d483-493f-8529-dae12f953bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.464702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3e2aa8ad-d483-493f-8529-dae12f953bb6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:35:30.466791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3e2aa8ad-d483-493f-8529-dae12f953bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:30.480600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1124/2232] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:35:30.487944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888753a1-8dff-41b2-b677-7620840779c2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:30.505536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888753a1-8dff-41b2-b677-7620840779c2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:30.513382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9810a13-30f3-4c13-bce3-e49dfc338b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:30.514416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9810a13-30f3-4c13-bce3-e49dfc338b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.514977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9810a13-30f3-4c13-bce3-e49dfc338b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.515429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9810a13-30f3-4c13-bce3-e49dfc338b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.517094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9810a13-30f3-4c13-bce3-e49dfc338b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:35:30.517541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9810a13-30f3-4c13-bce3-e49dfc338b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:30.519616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9810a13-30f3-4c13-bce3-e49dfc338b20 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:30.530464 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:30.538230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1109/2233] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:35:30.541766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2aa8ad-d483-493f-8529-dae12f953bb6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:30.552965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2aa8ad-d483-493f-8529-dae12f953bb6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:30.558680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ce338-9a8d-4c07-955e-11d1ec8d9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:30.559416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ce338-9a8d-4c07-955e-11d1ec8d9def admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.559706 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ce338-9a8d-4c07-955e-11d1ec8d9def admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.560037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ce338-9a8d-4c07-955e-11d1ec8d9def admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.561027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ce338-9a8d-4c07-955e-11d1ec8d9def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:30.563320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ce338-9a8d-4c07-955e-11d1ec8d9def admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:30.603942 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1125/2234] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:35:30 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:35:30.609180 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9810a13-30f3-4c13-bce3-e49dfc338b20 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:30.623859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9810a13-30f3-4c13-bce3-e49dfc338b20 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:30.697550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566e28-3ffa-4d18-944f-6a955ea445a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:30.698102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566e28-3ffa-4d18-944f-6a955ea445a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.698377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566e28-3ffa-4d18-944f-6a955ea445a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.698678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566e28-3ffa-4d18-944f-6a955ea445a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.699341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8566e28-3ffa-4d18-944f-6a955ea445a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:30.701358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8566e28-3ffa-4d18-944f-6a955ea445a0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:30.730623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1110/2235] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:35:30 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:35:30.734948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ce338-9a8d-4c07-955e-11d1ec8d9def admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:30.747409 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ce338-9a8d-4c07-955e-11d1ec8d9def admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:30.753105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c7022-184a-4527-857c-5e643dedaffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:30.754019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c7022-184a-4527-857c-5e643dedaffd admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.754362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c7022-184a-4527-857c-5e643dedaffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.754920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c7022-184a-4527-857c-5e643dedaffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.755405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c7022-184a-4527-857c-5e643dedaffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:30.757202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c7022-184a-4527-857c-5e643dedaffd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:30.782558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1126/2236] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:35:30.784820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566e28-3ffa-4d18-944f-6a955ea445a0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:30.802539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566e28-3ffa-4d18-944f-6a955ea445a0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:30.810377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca90fa-4199-4f2b-abfe-8e7f504c018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:30.811671 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca90fa-4199-4f2b-abfe-8e7f504c018f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.812866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca90fa-4199-4f2b-abfe-8e7f504c018f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.813318 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca90fa-4199-4f2b-abfe-8e7f504c018f admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.814122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca90fa-4199-4f2b-abfe-8e7f504c018f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:30.816530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca90fa-4199-4f2b-abfe-8e7f504c018f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:30.831345 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1111/2237] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:35:30.837824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c7022-184a-4527-857c-5e643dedaffd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:30.852505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c7022-184a-4527-857c-5e643dedaffd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:30.859780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e205182-f2cd-4f08-b59c-bdf94183b102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:30.860675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205182-f2cd-4f08-b59c-bdf94183b102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.860988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205182-f2cd-4f08-b59c-bdf94183b102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.861298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205182-f2cd-4f08-b59c-bdf94183b102 admin admin] PATH_INFO: `/v3/projects/1364a1cc9e3f462896872fe2b51edcce/users/4b4f8b151d1a4668b9d6119417af9051/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.881654 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e205182-f2cd-4f08-b59c-bdf94183b102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1364a1cc9e3f462896872fe2b51edcce, user_id=4b4f8b151d1a4668b9d6119417af9051, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:30.884523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e205182-f2cd-4f08-b59c-bdf94183b102 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:30.900824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1127/2238] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:35:30 2022] PUT /identity/v3/projects/1364a1cc9e3f462896872fe2b51edcce/users/4b4f8b151d1a4668b9d6119417af9051/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:35:30.915266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554394e-607e-44f7-b8d1-cbf22e73292a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:30.915873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554394e-607e-44f7-b8d1-cbf22e73292a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:30.916389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554394e-607e-44f7-b8d1-cbf22e73292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:30.971632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5554394e-607e-44f7-b8d1-cbf22e73292a None None] MFA Rules not processed for user `4b4f8b151d1a4668b9d6119417af9051`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:35:30.973765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5554394e-607e-44f7-b8d1-cbf22e73292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:31.105392 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1112/2239] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:35:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:35:31.126752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e205182-f2cd-4f08-b59c-bdf94183b102 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:31.130088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8e205182-f2cd-4f08-b59c-bdf94183b102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:31.155725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:31.225320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e205182-f2cd-4f08-b59c-bdf94183b102 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:31.229337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4bfe-f70b-4ede-ae39-f6aa6b25e02b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c0b33c2c7947c59ebf8da17abbd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:31.230030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4bfe-f70b-4ede-ae39-f6aa6b25e02b service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:31.230365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4bfe-f70b-4ede-ae39-f6aa6b25e02b service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:31.230800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4bfe-f70b-4ede-ae39-f6aa6b25e02b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:31.241643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f4bfe-f70b-4ede-ae39-f6aa6b25e02b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:31.243111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f4bfe-f70b-4ede-ae39-f6aa6b25e02b service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:31.255114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1128/2240] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:35:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:35:41.100334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:41.249307 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=20 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:48.386094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53239592-e58b-45c2-aa65-b71c4547bf46 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:48.387048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53239592-e58b-45c2-aa65-b71c4547bf46 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:48.387048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53239592-e58b-45c2-aa65-b71c4547bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:48.426924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-53239592-e58b-45c2-aa65-b71c4547bf46 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:35:48.429538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-53239592-e58b-45c2-aa65-b71c4547bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:48.540987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1113/2241] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:35:48.570419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4bfe-f70b-4ede-ae39-f6aa6b25e02b service glance] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:48.572871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-be4f4bfe-f70b-4ede-ae39-f6aa6b25e02b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:48.694803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4bfe-f70b-4ede-ae39-f6aa6b25e02b service glance] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:48.701346 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ef74d-f54c-4924-b998-e69fc44397bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:48.701987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ef74d-f54c-4924-b998-e69fc44397bf service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:48.702259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ef74d-f54c-4924-b998-e69fc44397bf service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:48.702824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ef74d-f54c-4924-b998-e69fc44397bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:48.715445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ef74d-f54c-4924-b998-e69fc44397bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:48.717167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ef74d-f54c-4924-b998-e69fc44397bf service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:48.732310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1129/2242] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:35:54.776387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000981-9ec3-4345-bce5-4617ec096b2a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:54.777310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000981-9ec3-4345-bce5-4617ec096b2a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:54.777697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000981-9ec3-4345-bce5-4617ec096b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:54.815793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c7000981-9ec3-4345-bce5-4617ec096b2a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:35:54.817490 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c7000981-9ec3-4345-bce5-4617ec096b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:35:54.827465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1114/2243] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:35:54.913579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ef74d-f54c-4924-b998-e69fc44397bf service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:35:54.940841 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ef74d-f54c-4924-b998-e69fc44397bf service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:35:54.951468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d1630-6076-45fe-910a-92f0a7af9da1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:35:54.952788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d1630-6076-45fe-910a-92f0a7af9da1 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:35:54.953547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d1630-6076-45fe-910a-92f0a7af9da1 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:35:54.954027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d1630-6076-45fe-910a-92f0a7af9da1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:35:54.972356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d1630-6076-45fe-910a-92f0a7af9da1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:35:54.976564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d1630-6076-45fe-910a-92f0a7af9da1 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:35:54.998695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1130/2244] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:36:02.496134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9c71-0bb4-4157-bcb1-1d337b1356cc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:02.496824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9c71-0bb4-4157-bcb1-1d337b1356cc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:02.496824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9c71-0bb4-4157-bcb1-1d337b1356cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:02.521878 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a6ca9c71-0bb4-4157-bcb1-1d337b1356cc None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:02.523170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a6ca9c71-0bb4-4157-bcb1-1d337b1356cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:02.533144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1115/2245] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:02.555105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d1630-6076-45fe-910a-92f0a7af9da1 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:02.557747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e57d1630-6076-45fe-910a-92f0a7af9da1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:02.581107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d1630-6076-45fe-910a-92f0a7af9da1 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:02.590055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b13fb-3d6a-4a61-8d28-acd80a08d1b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:02.591403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b13fb-3d6a-4a61-8d28-acd80a08d1b4 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:02.592074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b13fb-3d6a-4a61-8d28-acd80a08d1b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:02.593542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b13fb-3d6a-4a61-8d28-acd80a08d1b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:02.603342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b13fb-3d6a-4a61-8d28-acd80a08d1b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:02.605059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b13fb-3d6a-4a61-8d28-acd80a08d1b4 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:02.623523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1131/2246] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:36:04.395170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfbf00-d427-4d35-984b-d3f749e22903 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:04.395940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfbf00-d427-4d35-984b-d3f749e22903 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:04.396088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfbf00-d427-4d35-984b-d3f749e22903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:04.426554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-86bfbf00-d427-4d35-984b-d3f749e22903 None None] MFA Rules not processed for user `f447a34300944a5da25f6408f802f602`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:04.428588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-86bfbf00-d427-4d35-984b-d3f749e22903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:04.503194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1116/2247] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:07.521226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f4477-621f-4460-ae29-fc05ae58e869 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:07.521870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f4477-621f-4460-ae29-fc05ae58e869 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:07.522087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f4477-621f-4460-ae29-fc05ae58e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:07.551308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3f0f4477-621f-4460-ae29-fc05ae58e869 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:07.553424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3f0f4477-621f-4460-ae29-fc05ae58e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:07.567823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1132/2248] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:36:07.595679 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfbf00-d427-4d35-984b-d3f749e22903 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:07.611032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfbf00-d427-4d35-984b-d3f749e22903 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:07.617293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fad4b-e228-499e-b622-cc8831ca98cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:07.618061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fad4b-e228-499e-b622-cc8831ca98cd service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:07.618231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fad4b-e228-499e-b622-cc8831ca98cd service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:07.618460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fad4b-e228-499e-b622-cc8831ca98cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:07.629267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fad4b-e228-499e-b622-cc8831ca98cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:07.631303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fad4b-e228-499e-b622-cc8831ca98cd service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:07.644709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1117/2249] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:36:09.936944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f4477-621f-4460-ae29-fc05ae58e869 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:09.941039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3f0f4477-621f-4460-ae29-fc05ae58e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:10.098380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f4477-621f-4460-ae29-fc05ae58e869 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:10.104916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:10.105613 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:10.105939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:10.106286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:10.109459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:10.123554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:10.126552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:10.145628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1133/2250] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:36:11.233841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4ddaa-badc-42e3-ab92-79b6765e502b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:11.233841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4ddaa-badc-42e3-ab92-79b6765e502b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:11.233841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4ddaa-badc-42e3-ab92-79b6765e502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:11.245338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=65 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:11.268032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-29c4ddaa-badc-42e3-ab92-79b6765e502b None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:11.269500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-29c4ddaa-badc-42e3-ab92-79b6765e502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:11.355110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1118/2251] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:11.387999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:11.389604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:11.395800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=82 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:11.509222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cecfcdd-0349-44cc-b826-d094ed75cbbc service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:11.516934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2892a3b-7686-4007-a445-b97edd8d7090 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:11.517749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2892a3b-7686-4007-a445-b97edd8d7090 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:11.518114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2892a3b-7686-4007-a445-b97edd8d7090 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:11.518620 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2892a3b-7686-4007-a445-b97edd8d7090 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:11.529275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2892a3b-7686-4007-a445-b97edd8d7090 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:11.531633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2892a3b-7686-4007-a445-b97edd8d7090 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:11.543031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1134/2252] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:36:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:36:14.907598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4ddaa-badc-42e3-ab92-79b6765e502b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:14.953961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4ddaa-badc-42e3-ab92-79b6765e502b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:14.969218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:14.969797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:14.970188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:14.970393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] PATH_INFO: `/v3/users/4b4f8b151d1a4668b9d6119417af9051` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:14.973542 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4f8b151d1a4668b9d6119417af9051)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:14.975655 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:15.178926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4f8b151d1a4668b9d6119417af9051'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:15.181786 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4f8b151d1a4668b9d6119417af9051'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:15.184488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4f8b151d1a4668b9d6119417af9051'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:15.236277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4f8b151d1a4668b9d6119417af9051'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:15.275284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878fef8-3a26-4d0a-9498-d635ad69ff94 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:15.276202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878fef8-3a26-4d0a-9498-d635ad69ff94 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:15.277187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878fef8-3a26-4d0a-9498-d635ad69ff94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:15.285858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98342494-5236-457b-ae53-ffeebbfd809b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4f8b151d1a4668b9d6119417af9051'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:15.334909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e878fef8-3a26-4d0a-9498-d635ad69ff94 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:15.337224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e878fef8-3a26-4d0a-9498-d635ad69ff94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:15.350067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1119/2253] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:36:14 2022] DELETE /identity/v3/users/4b4f8b151d1a4668b9d6119417af9051 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:36:15.354775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c194da-3bf6-4bda-bc7b-01433be68082 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:15.355352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c194da-3bf6-4bda-bc7b-01433be68082 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:15.356757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c194da-3bf6-4bda-bc7b-01433be68082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:15.359352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1135/2254] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:15.395848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b8c194da-3bf6-4bda-bc7b-01433be68082 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:15.398087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878fef8-3a26-4d0a-9498-d635ad69ff94 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:15.399076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b8c194da-3bf6-4bda-bc7b-01433be68082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:15.408100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e878fef8-3a26-4d0a-9498-d635ad69ff94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:15.446208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878fef8-3a26-4d0a-9498-d635ad69ff94 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:15.616781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1120/2255] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:15.624805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c194da-3bf6-4bda-bc7b-01433be68082 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:15.629210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b8c194da-3bf6-4bda-bc7b-01433be68082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:15.689416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:15.750001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294c2c5-7e25-49e2-9feb-512e082861b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:15.752238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c2c5-7e25-49e2-9feb-512e082861b3 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:15.754238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c2c5-7e25-49e2-9feb-512e082861b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:15.754898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c2c5-7e25-49e2-9feb-512e082861b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:15.794968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c194da-3bf6-4bda-bc7b-01433be68082 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:15.817075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294c2c5-7e25-49e2-9feb-512e082861b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:15.829775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294c2c5-7e25-49e2-9feb-512e082861b3 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:15.849643 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca0489-86f8-4713-a8b5-cb012ef437da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:15.850890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca0489-86f8-4713-a8b5-cb012ef437da service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:15.852061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca0489-86f8-4713-a8b5-cb012ef437da service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:15.852287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca0489-86f8-4713-a8b5-cb012ef437da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:15.874181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1136/2256] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:36:15.947400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca0489-86f8-4713-a8b5-cb012ef437da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:15.949189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca0489-86f8-4713-a8b5-cb012ef437da service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:15.987279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1121/2257] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:36:17.569264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294c2c5-7e25-49e2-9feb-512e082861b3 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:17.572775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8294c2c5-7e25-49e2-9feb-512e082861b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:17.622897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294c2c5-7e25-49e2-9feb-512e082861b3 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:17.654134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:17.655699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:17.656052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:17.656561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] PATH_INFO: `/v3/projects/1364a1cc9e3f462896872fe2b51edcce` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:17.659284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1364a1cc9e3f462896872fe2b51edcce)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:17.664883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:17.823414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1364a1cc9e3f462896872fe2b51edcce', 'request_id': 'req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:17.839814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1364a1cc9e3f462896872fe2b51edcce', 'request_id': 'req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:17.868332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1364a1cc9e3f462896872fe2b51edcce', 'request_id': 'req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:17.884219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:17.906545 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] The token cache is being invalidate because project 1364a1cc9e3f462896872fe2b51edcce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:36:17.907515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:17.908808 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c076f8a9-3d70-4b8a-a949-d1b5ef0410ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:36:17.917352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1137/2258] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:36:17 2022] DELETE /identity/v3/projects/1364a1cc9e3f462896872fe2b51edcce => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:36:17.920108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd524dc-1074-485e-802b-e89dfeb91420 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:17.921128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd524dc-1074-485e-802b-e89dfeb91420 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:17.921128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd524dc-1074-485e-802b-e89dfeb91420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:17.958020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5fd524dc-1074-485e-802b-e89dfeb91420 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:17.959936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5fd524dc-1074-485e-802b-e89dfeb91420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:18.074531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1122/2259] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:18.083390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07b1a8-007a-4565-b0bd-ad6406891bbf None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:18.083694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07b1a8-007a-4565-b0bd-ad6406891bbf None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:18.083924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07b1a8-007a-4565-b0bd-ad6406891bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:18.133946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8c07b1a8-007a-4565-b0bd-ad6406891bbf None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:18.136974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8c07b1a8-007a-4565-b0bd-ad6406891bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:18.162762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1138/2260] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:18.166832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd524dc-1074-485e-802b-e89dfeb91420 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:18.195376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd524dc-1074-485e-802b-e89dfeb91420 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:18.220399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98077656-da94-4a0b-8ece-ad2cf86f2752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:18.222012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98077656-da94-4a0b-8ece-ad2cf86f2752 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:18.223778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98077656-da94-4a0b-8ece-ad2cf86f2752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:18.224418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98077656-da94-4a0b-8ece-ad2cf86f2752 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:18.226048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98077656-da94-4a0b-8ece-ad2cf86f2752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:36:18.227275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98077656-da94-4a0b-8ece-ad2cf86f2752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:18.231820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98077656-da94-4a0b-8ece-ad2cf86f2752 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:18.275315 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1123/2261] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:36:18.280505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07b1a8-007a-4565-b0bd-ad6406891bbf None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:18.309959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07b1a8-007a-4565-b0bd-ad6406891bbf None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:18.324105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7933a6-24ce-4913-8d96-bf5d5f932c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:18.324887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7933a6-24ce-4913-8d96-bf5d5f932c71 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:18.325172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7933a6-24ce-4913-8d96-bf5d5f932c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:18.325474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7933a6-24ce-4913-8d96-bf5d5f932c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:18.326060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7933a6-24ce-4913-8d96-bf5d5f932c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:18.330548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7933a6-24ce-4913-8d96-bf5d5f932c71 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:18.401858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1139/2262] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:36:18 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:36:18.410883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98077656-da94-4a0b-8ece-ad2cf86f2752 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:18.488075 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98077656-da94-4a0b-8ece-ad2cf86f2752 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:18.663968 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971a32d-f5b2-4194-b1fb-95b08ccff354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:18.664606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971a32d-f5b2-4194-b1fb-95b08ccff354 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:18.664880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971a32d-f5b2-4194-b1fb-95b08ccff354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:18.665146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971a32d-f5b2-4194-b1fb-95b08ccff354 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:18.665868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971a32d-f5b2-4194-b1fb-95b08ccff354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:18.667891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971a32d-f5b2-4194-b1fb-95b08ccff354 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:18.700081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1124/2263] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:36:18 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:36:18.702006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7933a6-24ce-4913-8d96-bf5d5f932c71 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:18.735819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7933a6-24ce-4913-8d96-bf5d5f932c71 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:18.750195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024a507-0be9-4032-a2f4-4d9b74cf8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:18.751041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024a507-0be9-4032-a2f4-4d9b74cf8da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:18.751423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024a507-0be9-4032-a2f4-4d9b74cf8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:18.751814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024a507-0be9-4032-a2f4-4d9b74cf8da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:18.752579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024a507-0be9-4032-a2f4-4d9b74cf8da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:18.754543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024a507-0be9-4032-a2f4-4d9b74cf8da7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:18.776743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1140/2264] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:36:18.777947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971a32d-f5b2-4194-b1fb-95b08ccff354 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:18.791022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971a32d-f5b2-4194-b1fb-95b08ccff354 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:18.798245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5bb03-18d9-400f-81f9-ae2c2b39df65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:18.799509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5bb03-18d9-400f-81f9-ae2c2b39df65 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:18.800136 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5bb03-18d9-400f-81f9-ae2c2b39df65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:18.800735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5bb03-18d9-400f-81f9-ae2c2b39df65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:18.801689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5bb03-18d9-400f-81f9-ae2c2b39df65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:18.804129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5bb03-18d9-400f-81f9-ae2c2b39df65 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:18.839034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1125/2265] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:36:18.840586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024a507-0be9-4032-a2f4-4d9b74cf8da7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:18.856823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024a507-0be9-4032-a2f4-4d9b74cf8da7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:18.863023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35d847-2200-4ce5-b6f2-3d1c9d07ebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:18.864026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35d847-2200-4ce5-b6f2-3d1c9d07ebc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:18.864401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35d847-2200-4ce5-b6f2-3d1c9d07ebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:18.865034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35d847-2200-4ce5-b6f2-3d1c9d07ebc1 admin admin] PATH_INFO: `/v3/projects/f0af57c134de4e0a888e90e50510d915/users/b829d1bdf9764cefa06ca6f9c5f69296/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:18.905153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35d847-2200-4ce5-b6f2-3d1c9d07ebc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0af57c134de4e0a888e90e50510d915, user_id=b829d1bdf9764cefa06ca6f9c5f69296, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:18.912708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35d847-2200-4ce5-b6f2-3d1c9d07ebc1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:18.940145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1141/2266] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:36:18 2022] PUT /identity/v3/projects/f0af57c134de4e0a888e90e50510d915/users/b829d1bdf9764cefa06ca6f9c5f69296/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:36:18.946126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d35f38-a0e4-4402-844e-299e4cdefb10 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:18.946972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d35f38-a0e4-4402-844e-299e4cdefb10 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:18.947446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d35f38-a0e4-4402-844e-299e4cdefb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:19.008794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e1d35f38-a0e4-4402-844e-299e4cdefb10 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:19.011261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e1d35f38-a0e4-4402-844e-299e4cdefb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:19.082755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:19.195703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1126/2267] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:19.223053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35d847-2200-4ce5-b6f2-3d1c9d07ebc1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:19.223053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ea35d847-2200-4ce5-b6f2-3d1c9d07ebc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:19.335594 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35d847-2200-4ce5-b6f2-3d1c9d07ebc1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:19.339990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a1413-e199-4517-947f-49304d3c531a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:19.341277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a1413-e199-4517-947f-49304d3c531a service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:19.341998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a1413-e199-4517-947f-49304d3c531a service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:19.342873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a1413-e199-4517-947f-49304d3c531a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:19.359475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a1413-e199-4517-947f-49304d3c531a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:19.362208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a1413-e199-4517-947f-49304d3c531a service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:19.374882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1142/2268] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:36:23.116863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e2f68-5da4-467c-963c-8e6667341fd9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:23.118480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e2f68-5da4-467c-963c-8e6667341fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:23.119320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e2f68-5da4-467c-963c-8e6667341fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:23.231870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-491e2f68-5da4-467c-963c-8e6667341fd9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:23.235110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-491e2f68-5da4-467c-963c-8e6667341fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:23.266256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1127/2269] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:23.826494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a1413-e199-4517-947f-49304d3c531a service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:23.840447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-515a1413-e199-4517-947f-49304d3c531a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:24.054576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a1413-e199-4517-947f-49304d3c531a service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:24.062337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6353c-c13d-4d28-9111-7bf621506a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:24.063118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6353c-c13d-4d28-9111-7bf621506a76 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:24.063681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6353c-c13d-4d28-9111-7bf621506a76 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:24.063968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6353c-c13d-4d28-9111-7bf621506a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:24.095338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6353c-c13d-4d28-9111-7bf621506a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:24.097149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6353c-c13d-4d28-9111-7bf621506a76 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:24.141166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1143/2270] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:36:29.869087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd80b0a-9670-4a6a-8881-623b0bccac54 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:29.869644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd80b0a-9670-4a6a-8881-623b0bccac54 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:29.869644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd80b0a-9670-4a6a-8881-623b0bccac54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:29.905765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fbd80b0a-9670-4a6a-8881-623b0bccac54 None None] MFA Rules not processed for user `b829d1bdf9764cefa06ca6f9c5f69296`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:29.907359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fbd80b0a-9670-4a6a-8881-623b0bccac54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:30.009140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1128/2271] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:36:30.009369 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6353c-c13d-4d28-9111-7bf621506a76 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:30.016988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6353c-c13d-4d28-9111-7bf621506a76 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:30.024647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d88150-f053-4c79-8c43-c61c907bb8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:30.025365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d88150-f053-4c79-8c43-c61c907bb8bd admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:30.025615 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d88150-f053-4c79-8c43-c61c907bb8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:30.026055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d88150-f053-4c79-8c43-c61c907bb8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:30.026767 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d88150-f053-4c79-8c43-c61c907bb8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:30.028725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d88150-f053-4c79-8c43-c61c907bb8bd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:30.068605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:30.099516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1144/2272] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:36:30 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:36:30.100638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd80b0a-9670-4a6a-8881-623b0bccac54 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:30.130406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd80b0a-9670-4a6a-8881-623b0bccac54 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:30.138265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a23d-b0a9-4f3c-9e3f-1e69c60fb607 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:30.138737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a23d-b0a9-4f3c-9e3f-1e69c60fb607 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:30.139181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a23d-b0a9-4f3c-9e3f-1e69c60fb607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:30.176460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bfc9a23d-b0a9-4f3c-9e3f-1e69c60fb607 None None] MFA Rules not processed for user `ae4f7f8855b5445d863a825ce921c982`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:30.178192 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bfc9a23d-b0a9-4f3c-9e3f-1e69c60fb607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:30.232181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5f23-0dc1-4332-99fa-1efc8d0b6022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:30.233309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5f23-0dc1-4332-99fa-1efc8d0b6022 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:30.233872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5f23-0dc1-4332-99fa-1efc8d0b6022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:30.234285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5f23-0dc1-4332-99fa-1efc8d0b6022 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:30.235432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c5f23-0dc1-4332-99fa-1efc8d0b6022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:30.237978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c5f23-0dc1-4332-99fa-1efc8d0b6022 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:30.275029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1145/2273] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:30.275513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1129/2274] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:36:30 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:36:30.286754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a23d-b0a9-4f3c-9e3f-1e69c60fb607 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:30.310180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a23d-b0a9-4f3c-9e3f-1e69c60fb607 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:30.316431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6a637-4c8e-4a48-bd7b-adf668af49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:30.317234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6a637-4c8e-4a48-bd7b-adf668af49d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:30.317575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6a637-4c8e-4a48-bd7b-adf668af49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:30.317938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6a637-4c8e-4a48-bd7b-adf668af49d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:30.320093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6a637-4c8e-4a48-bd7b-adf668af49d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:30.323042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6a637-4c8e-4a48-bd7b-adf668af49d6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:30.346064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1146/2275] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:36:30.353515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5f23-0dc1-4332-99fa-1efc8d0b6022 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:30.378616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5f23-0dc1-4332-99fa-1efc8d0b6022 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:30.384108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50af81-8c45-4501-9847-2a6fcd776de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:30.385293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50af81-8c45-4501-9847-2a6fcd776de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:30.385622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50af81-8c45-4501-9847-2a6fcd776de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:30.385928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50af81-8c45-4501-9847-2a6fcd776de4 admin admin] PATH_INFO: `/v3/projects/ab591cbd95e846f0a93b704899245b3f/users/1032935ff3fb401e9483640a2a89f048/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:30.408996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50af81-8c45-4501-9847-2a6fcd776de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab591cbd95e846f0a93b704899245b3f, user_id=1032935ff3fb401e9483640a2a89f048, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:30.412576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50af81-8c45-4501-9847-2a6fcd776de4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:30.438522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1130/2276] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:36:30 2022] PUT /identity/v3/projects/ab591cbd95e846f0a93b704899245b3f/users/1032935ff3fb401e9483640a2a89f048/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:36:30.439598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6a637-4c8e-4a48-bd7b-adf668af49d6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:30.457819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6a637-4c8e-4a48-bd7b-adf668af49d6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:30.650846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ae925-61ab-42d9-a890-d531e7b4739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:30.652844 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae925-61ab-42d9-a890-d531e7b4739c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:30.655730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae925-61ab-42d9-a890-d531e7b4739c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:30.656018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae925-61ab-42d9-a890-d531e7b4739c admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:30.656753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ae925-61ab-42d9-a890-d531e7b4739c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:30.660600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ae925-61ab-42d9-a890-d531e7b4739c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:30.696803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1147/2277] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:36:30.707161 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50af81-8c45-4501-9847-2a6fcd776de4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:30.731380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50af81-8c45-4501-9847-2a6fcd776de4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:30.755484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1987bd-c682-4439-8541-2b5668d34b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:30.758214 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1987bd-c682-4439-8541-2b5668d34b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:30.759068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1987bd-c682-4439-8541-2b5668d34b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:30.762137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1987bd-c682-4439-8541-2b5668d34b72 admin admin] PATH_INFO: `/v3/projects/ab591cbd95e846f0a93b704899245b3f/users/1032935ff3fb401e9483640a2a89f048/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:30.765033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1987bd-c682-4439-8541-2b5668d34b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab591cbd95e846f0a93b704899245b3f, user_id=1032935ff3fb401e9483640a2a89f048, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:30.769094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1987bd-c682-4439-8541-2b5668d34b72 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:30.784220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1131/2278] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:36:30 2022] PUT /identity/v3/projects/ab591cbd95e846f0a93b704899245b3f/users/1032935ff3fb401e9483640a2a89f048/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:36:39.775050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c873-6b9d-4aa8-99bf-369634500e44 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:39.775783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c873-6b9d-4aa8-99bf-369634500e44 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:39.775783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c873-6b9d-4aa8-99bf-369634500e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:39.828408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6856c873-6b9d-4aa8-99bf-369634500e44 None None] MFA Rules not processed for user `1032935ff3fb401e9483640a2a89f048`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:39.832213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6856c873-6b9d-4aa8-99bf-369634500e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:40.005682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1148/2279] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:40.019911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1987bd-c682-4439-8541-2b5668d34b72 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:40.022812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1c1987bd-c682-4439-8541-2b5668d34b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:40.034863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:40.138172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1987bd-c682-4439-8541-2b5668d34b72 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:40.144235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311ffef-79ee-4286-8c9d-dd0a5897dfc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c0b33c2c7947c59ebf8da17abbd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:40.144235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311ffef-79ee-4286-8c9d-dd0a5897dfc3 service glance] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:40.144687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311ffef-79ee-4286-8c9d-dd0a5897dfc3 service glance] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:40.144687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311ffef-79ee-4286-8c9d-dd0a5897dfc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:40.241939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311ffef-79ee-4286-8c9d-dd0a5897dfc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:40.242617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311ffef-79ee-4286-8c9d-dd0a5897dfc3 service glance] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:40.254424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1132/2280] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:36:40.452106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46110f-8e9d-48cd-9560-1669b7556d8c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:40.452477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46110f-8e9d-48cd-9560-1669b7556d8c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:40.452842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46110f-8e9d-48cd-9560-1669b7556d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:40.481211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1b46110f-8e9d-48cd-9560-1669b7556d8c None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:40.483354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1b46110f-8e9d-48cd-9560-1669b7556d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:40.493092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:40.679033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1149/2281] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:36:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:40.698342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311ffef-79ee-4286-8c9d-dd0a5897dfc3 service glance] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:40.702545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b311ffef-79ee-4286-8c9d-dd0a5897dfc3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:40.879747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311ffef-79ee-4286-8c9d-dd0a5897dfc3 service glance] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:40.892043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388afbeb-6f00-4cda-9611-76187b4e9f63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:40.894292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388afbeb-6f00-4cda-9611-76187b4e9f63 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:40.895040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388afbeb-6f00-4cda-9611-76187b4e9f63 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:40.895637 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388afbeb-6f00-4cda-9611-76187b4e9f63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:40.914780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388afbeb-6f00-4cda-9611-76187b4e9f63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:40.918463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388afbeb-6f00-4cda-9611-76187b4e9f63 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:40.936825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1133/2282] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:36:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:44.332923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d42d-44d8-4833-a596-2b01e43869a7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:44.333752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d42d-44d8-4833-a596-2b01e43869a7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:44.333920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d42d-44d8-4833-a596-2b01e43869a7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:44.336184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1150/2283] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:36:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:36:44.346170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9ceb8-76dc-4948-8d6b-47450a47e368 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:44.346922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9ceb8-76dc-4948-8d6b-47450a47e368 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:44.347292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9ceb8-76dc-4948-8d6b-47450a47e368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:44.424268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-06b9ceb8-76dc-4948-8d6b-47450a47e368 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:44.435133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-06b9ceb8-76dc-4948-8d6b-47450a47e368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:44.692969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:44.860561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1134/2284] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:36:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:36:44.893628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2d42d-44d8-4833-a596-2b01e43869a7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:44.971129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2d42d-44d8-4833-a596-2b01e43869a7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:44.992979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3ef3c-3c5d-447a-b923-da47ba8d8239 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c0b33c2c7947c59ebf8da17abbd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:44.994238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3ef3c-3c5d-447a-b923-da47ba8d8239 service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:44.999641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3ef3c-3c5d-447a-b923-da47ba8d8239 service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:45.000321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3ef3c-3c5d-447a-b923-da47ba8d8239 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:45.055313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3ef3c-3c5d-447a-b923-da47ba8d8239 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:45.059478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3ef3c-3c5d-447a-b923-da47ba8d8239 service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:45.104141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1151/2285] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:36:45.367043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778c97-4e77-401d-8ac3-810df747e891 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:45.367885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778c97-4e77-401d-8ac3-810df747e891 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:45.367885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778c97-4e77-401d-8ac3-810df747e891 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:45.369394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1135/2286] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:36:45.383410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19ce91-c937-4ad0-98cb-88c95d7f8131 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:45.384243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19ce91-c937-4ad0-98cb-88c95d7f8131 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:45.384243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19ce91-c937-4ad0-98cb-88c95d7f8131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:45.455280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ac19ce91-c937-4ad0-98cb-88c95d7f8131 None None] MFA Rules not processed for user `0e7bc56706f2491b92f5745a0fbc2acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:45.457757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ac19ce91-c937-4ad0-98cb-88c95d7f8131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:45.690771 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1152/2287] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:36:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:36:45.723557 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87778c97-4e77-401d-8ac3-810df747e891 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:45.760188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87778c97-4e77-401d-8ac3-810df747e891 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:45.779564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caac21e-ef50-418b-998a-a8f8f5ee23b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:45.781193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caac21e-ef50-418b-998a-a8f8f5ee23b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:45.782019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caac21e-ef50-418b-998a-a8f8f5ee23b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:45.782822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caac21e-ef50-418b-998a-a8f8f5ee23b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:45.818299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caac21e-ef50-418b-998a-a8f8f5ee23b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:45.822243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caac21e-ef50-418b-998a-a8f8f5ee23b0 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:45.855065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1136/2288] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:36:46.173184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6b8b-a649-4af6-9c10-b791c0f6af20 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:46.173473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6b8b-a649-4af6-9c10-b791c0f6af20 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:46.173929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6b8b-a649-4af6-9c10-b791c0f6af20 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:46.175950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1153/2289] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:36:46.192335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa710-791a-4886-923b-709e249ac27c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:46.192779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa710-791a-4886-923b-709e249ac27c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:46.193149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa710-791a-4886-923b-709e249ac27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:46.238250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-33bfa710-791a-4886-923b-709e249ac27c None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:46.243781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-33bfa710-791a-4886-923b-709e249ac27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:46.277862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1137/2290] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:36:46.314031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6b8b-a649-4af6-9c10-b791c0f6af20 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:46.335008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6b8b-a649-4af6-9c10-b791c0f6af20 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:46.341918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b92129-a7d7-44e9-a71e-3c54ed984a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:46.342937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b92129-a7d7-44e9-a71e-3c54ed984a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:46.343433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b92129-a7d7-44e9-a71e-3c54ed984a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:46.344426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b92129-a7d7-44e9-a71e-3c54ed984a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:46.362279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b92129-a7d7-44e9-a71e-3c54ed984a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:46.365088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b92129-a7d7-44e9-a71e-3c54ed984a00 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:46.385253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1154/2291] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:36:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:36:51.084617 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb4534-b56d-4dfd-a492-627cdaa9ba1b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:51.085809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb4534-b56d-4dfd-a492-627cdaa9ba1b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:51.086320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb4534-b56d-4dfd-a492-627cdaa9ba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:51.128705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bfbb4534-b56d-4dfd-a492-627cdaa9ba1b None None] MFA Rules not processed for user `b985a376cdbd45bf80a3142ffbd81fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:51.130855 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bfbb4534-b56d-4dfd-a492-627cdaa9ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:51.291109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1138/2292] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:55.986775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aad061-ebc0-4082-a046-dcf44edf1f02 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:55.987417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aad061-ebc0-4082-a046-dcf44edf1f02 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:55.987695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aad061-ebc0-4082-a046-dcf44edf1f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:56.029997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-30aad061-ebc0-4082-a046-dcf44edf1f02 None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:56.032657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-30aad061-ebc0-4082-a046-dcf44edf1f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:56.045299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1155/2293] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:36:56.081040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb4534-b56d-4dfd-a492-627cdaa9ba1b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:36:56.101141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb4534-b56d-4dfd-a492-627cdaa9ba1b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:36:56.118430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e8e3c-9d08-4a3b-be5a-45c034632a0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:36:56.119412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e8e3c-9d08-4a3b-be5a-45c034632a0d service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:56.119850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e8e3c-9d08-4a3b-be5a-45c034632a0d service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:56.120272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e8e3c-9d08-4a3b-be5a-45c034632a0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:56.141940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e8e3c-9d08-4a3b-be5a-45c034632a0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:36:56.143873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e8e3c-9d08-4a3b-be5a-45c034632a0d service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:36:56.156723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1139/2294] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:36:59.907632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537a056-cf63-46e1-85af-692766bab3fd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:36:59.908581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537a056-cf63-46e1-85af-692766bab3fd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:36:59.908581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537a056-cf63-46e1-85af-692766bab3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:36:59.930008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3537a056-cf63-46e1-85af-692766bab3fd None None] MFA Rules not processed for user `b829d1bdf9764cefa06ca6f9c5f69296`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:36:59.931430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3537a056-cf63-46e1-85af-692766bab3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:36:59.940180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1156/2295] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:36:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:37:06.152591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=49 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:09.923916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=61 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:19.688669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c5499-5afe-43f1-b5aa-750096f90885 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:19.689631 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c5499-5afe-43f1-b5aa-750096f90885 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:19.689631 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c5499-5afe-43f1-b5aa-750096f90885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:19.720382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-947c5499-5afe-43f1-b5aa-750096f90885 None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:37:19.723899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-947c5499-5afe-43f1-b5aa-750096f90885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:19.734026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1140/2296] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:37:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:37:19.769925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537a056-cf63-46e1-85af-692766bab3fd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:19.785796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537a056-cf63-46e1-85af-692766bab3fd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:19.791757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce0574-e142-40d3-be3b-975a38168819 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:19.792501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce0574-e142-40d3-be3b-975a38168819 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:19.794821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce0574-e142-40d3-be3b-975a38168819 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:19.795229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce0574-e142-40d3-be3b-975a38168819 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:19.807615 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce0574-e142-40d3-be3b-975a38168819 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:19.810479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce0574-e142-40d3-be3b-975a38168819 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:19.820989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1157/2297] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:37:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:37:29.710053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:29.823424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=6 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:34.597759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c5499-5afe-43f1-b5aa-750096f90885 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:34.599929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-947c5499-5afe-43f1-b5aa-750096f90885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:34.616245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c5499-5afe-43f1-b5aa-750096f90885 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:34.622174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dfccd-567e-4855-a477-192f5f8a7c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:34.622940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dfccd-567e-4855-a477-192f5f8a7c76 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:34.623279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dfccd-567e-4855-a477-192f5f8a7c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:34.623620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dfccd-567e-4855-a477-192f5f8a7c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:34.625660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c49dfccd-567e-4855-a477-192f5f8a7c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:34.641075 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dfccd-567e-4855-a477-192f5f8a7c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:34.642781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dfccd-567e-4855-a477-192f5f8a7c76 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:34.657204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1141/2298] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:37:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:37:34.677736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce0574-e142-40d3-be3b-975a38168819 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:34.691987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce0574-e142-40d3-be3b-975a38168819 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:34.700211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6f141-6abd-459a-bae8-47d844a45ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:34.700493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f141-6abd-459a-bae8-47d844a45ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:34.700747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f141-6abd-459a-bae8-47d844a45ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:34.701247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f141-6abd-459a-bae8-47d844a45ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:34.704718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-66f6f141-6abd-459a-bae8-47d844a45ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:34.730641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6f141-6abd-459a-bae8-47d844a45ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:34.733621 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6f141-6abd-459a-bae8-47d844a45ac3 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:34.755248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1158/2299] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:37:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:37:43.651906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca06faa-1615-4f5c-8c76-e71ca801473c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:43.654684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca06faa-1615-4f5c-8c76-e71ca801473c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:43.655636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca06faa-1615-4f5c-8c76-e71ca801473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:43.710118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-eca06faa-1615-4f5c-8c76-e71ca801473c None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:37:43.712988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-eca06faa-1615-4f5c-8c76-e71ca801473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:43.730839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1142/2300] 10.222.0.78 () {58 vars in 967 bytes} [Wed Aug 24 03:37:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:37:43.759989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6f141-6abd-459a-bae8-47d844a45ac3 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:43.785730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6f141-6abd-459a-bae8-47d844a45ac3 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:43.796397 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bea62-7fa2-4eeb-a8d8-eb220f11ee0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:43.798020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bea62-7fa2-4eeb-a8d8-eb220f11ee0d service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:43.798816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bea62-7fa2-4eeb-a8d8-eb220f11ee0d service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:43.799616 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bea62-7fa2-4eeb-a8d8-eb220f11ee0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:43.818616 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bea62-7fa2-4eeb-a8d8-eb220f11ee0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:43.822392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bea62-7fa2-4eeb-a8d8-eb220f11ee0d service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:43.843916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1159/2301] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:37:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:37:49.838349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca06faa-1615-4f5c-8c76-e71ca801473c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:49.841754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-eca06faa-1615-4f5c-8c76-e71ca801473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:49.877734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca06faa-1615-4f5c-8c76-e71ca801473c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:49.885613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c9d11-a01c-4c41-8469-47ce85db14b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:49.886834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c9d11-a01c-4c41-8469-47ce85db14b5 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:49.887364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c9d11-a01c-4c41-8469-47ce85db14b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:49.887728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c9d11-a01c-4c41-8469-47ce85db14b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:49.890177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ca8c9d11-a01c-4c41-8469-47ce85db14b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:49.999790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c9d11-a01c-4c41-8469-47ce85db14b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:50.002922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c9d11-a01c-4c41-8469-47ce85db14b5 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:50.020804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1143/2302] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:37:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:37:52.889720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4fde1-c27f-4ebb-bbe2-76559b9560e8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:52.890354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4fde1-c27f-4ebb-bbe2-76559b9560e8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:52.890354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4fde1-c27f-4ebb-bbe2-76559b9560e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:52.918858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1ed4fde1-c27f-4ebb-bbe2-76559b9560e8 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:37:52.920846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1ed4fde1-c27f-4ebb-bbe2-76559b9560e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:52.996834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1160/2303] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:37:53.039411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c9d11-a01c-4c41-8469-47ce85db14b5 service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:53.054081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c9d11-a01c-4c41-8469-47ce85db14b5 service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:53.062414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4d40-1b72-461d-9901-c969f4347e81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:53.063310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4d40-1b72-461d-9901-c969f4347e81 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:53.063684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4d40-1b72-461d-9901-c969f4347e81 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:53.064039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4d40-1b72-461d-9901-c969f4347e81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:53.075819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a4d40-1b72-461d-9901-c969f4347e81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:53.077582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a4d40-1b72-461d-9901-c969f4347e81 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:53.090831 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1144/2304] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:37:58.406706 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aebea-4267-498c-964c-9926505a86fc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:58.407305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aebea-4267-498c-964c-9926505a86fc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:58.407531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aebea-4267-498c-964c-9926505a86fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:58.435676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-038aebea-4267-498c-964c-9926505a86fc None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:37:58.437191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-038aebea-4267-498c-964c-9926505a86fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:58.447840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1161/2305] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:37:58.484860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4d40-1b72-461d-9901-c969f4347e81 service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:58.507151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4d40-1b72-461d-9901-c969f4347e81 service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:58.518177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11dab-99b6-4e83-8cb6-fe205faa1734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:58.519688 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11dab-99b6-4e83-8cb6-fe205faa1734 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:58.519932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11dab-99b6-4e83-8cb6-fe205faa1734 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:58.520838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11dab-99b6-4e83-8cb6-fe205faa1734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:58.533111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa11dab-99b6-4e83-8cb6-fe205faa1734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:58.535939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa11dab-99b6-4e83-8cb6-fe205faa1734 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:58.552948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1145/2306] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:03.580690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b785db-3edc-4a7a-ab23-079812fafabd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:03.581390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b785db-3edc-4a7a-ab23-079812fafabd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:03.581618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b785db-3edc-4a7a-ab23-079812fafabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:03.603945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=43 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:03.636128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a5b785db-3edc-4a7a-ab23-079812fafabd None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:03.638590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a5b785db-3edc-4a7a-ab23-079812fafabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:03.654433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1162/2307] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:03.691844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11dab-99b6-4e83-8cb6-fe205faa1734 service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:03.700657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=50 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:03.709209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11dab-99b6-4e83-8cb6-fe205faa1734 service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:03.718441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb7659-7ac5-435f-be73-fdb774321de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:03.719602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7659-7ac5-435f-be73-fdb774321de3 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:03.720144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7659-7ac5-435f-be73-fdb774321de3 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:03.720734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7659-7ac5-435f-be73-fdb774321de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:03.734988 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7659-7ac5-435f-be73-fdb774321de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:03.737235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7659-7ac5-435f-be73-fdb774321de3 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:03.750420 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1146/2308] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:38:04.875434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b785db-3edc-4a7a-ab23-079812fafabd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:04.889978 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b785db-3edc-4a7a-ab23-079812fafabd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:04.894480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a836870-09b4-424a-afed-137abeaf5c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:04.896013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a836870-09b4-424a-afed-137abeaf5c3a service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:04.896013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a836870-09b4-424a-afed-137abeaf5c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:04.896013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a836870-09b4-424a-afed-137abeaf5c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:04.907572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a836870-09b4-424a-afed-137abeaf5c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:04.909224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a836870-09b4-424a-afed-137abeaf5c3a service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:04.921946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1163/2309] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:07.942438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015b987-94b8-4e61-a902-bb0b98839821 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:07.943368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015b987-94b8-4e61-a902-bb0b98839821 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:07.943368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015b987-94b8-4e61-a902-bb0b98839821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:08.004087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a015b987-94b8-4e61-a902-bb0b98839821 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:08.006234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a015b987-94b8-4e61-a902-bb0b98839821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:08.020135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1147/2310] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:08.063630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a836870-09b4-424a-afed-137abeaf5c3a service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:08.085926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a836870-09b4-424a-afed-137abeaf5c3a service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:08.097501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf508b-7c58-49c4-bf71-231f703169ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:08.098620 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf508b-7c58-49c4-bf71-231f703169ba service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:08.099196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf508b-7c58-49c4-bf71-231f703169ba service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:08.099752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf508b-7c58-49c4-bf71-231f703169ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:08.117860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf508b-7c58-49c4-bf71-231f703169ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:08.121384 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf508b-7c58-49c4-bf71-231f703169ba service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:08.159802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1164/2311] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:11.430936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015b987-94b8-4e61-a902-bb0b98839821 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:11.445890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015b987-94b8-4e61-a902-bb0b98839821 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:11.451079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72044f71-9da6-452e-b77d-a66daa02b779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:11.452038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72044f71-9da6-452e-b77d-a66daa02b779 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:11.452374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72044f71-9da6-452e-b77d-a66daa02b779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:11.452675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72044f71-9da6-452e-b77d-a66daa02b779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:11.454935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-72044f71-9da6-452e-b77d-a66daa02b779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:11.469346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044f71-9da6-452e-b77d-a66daa02b779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:11.472750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044f71-9da6-452e-b77d-a66daa02b779 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:11.489202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1148/2312] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:14.307292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd742dd-a0ad-455f-9d3d-2c07a96d7abe None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:14.308206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd742dd-a0ad-455f-9d3d-2c07a96d7abe None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:14.308206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd742dd-a0ad-455f-9d3d-2c07a96d7abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:14.332895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fdd742dd-a0ad-455f-9d3d-2c07a96d7abe None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:14.334586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fdd742dd-a0ad-455f-9d3d-2c07a96d7abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:14.344560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1165/2313] 10.222.0.79 () {58 vars in 1016 bytes} [Wed Aug 24 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:38:14.380849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72044f71-9da6-452e-b77d-a66daa02b779 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:14.396506 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72044f71-9da6-452e-b77d-a66daa02b779 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:14.406057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d11c4c-efa6-4369-a1c9-d0ea3d6f184c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:14.407176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11c4c-efa6-4369-a1c9-d0ea3d6f184c service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:14.407657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11c4c-efa6-4369-a1c9-d0ea3d6f184c service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:14.408121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11c4c-efa6-4369-a1c9-d0ea3d6f184c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:14.423742 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d11c4c-efa6-4369-a1c9-d0ea3d6f184c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:14.426588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d11c4c-efa6-4369-a1c9-d0ea3d6f184c service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:14.445419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1149/2314] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:24.326112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=17 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:24.437150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=20 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:29.330472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd742dd-a0ad-455f-9d3d-2c07a96d7abe None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:29.348225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd742dd-a0ad-455f-9d3d-2c07a96d7abe None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:29.358790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb943a-c179-4894-ab4d-1d0f67af1a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:29.360219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb943a-c179-4894-ab4d-1d0f67af1a51 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:29.360934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb943a-c179-4894-ab4d-1d0f67af1a51 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:29.361873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb943a-c179-4894-ab4d-1d0f67af1a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:29.365394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8acb943a-c179-4894-ab4d-1d0f67af1a51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:29.382698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb943a-c179-4894-ab4d-1d0f67af1a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:29.384446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb943a-c179-4894-ab4d-1d0f67af1a51 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:29.397494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1166/2315] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:33.932734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d11c4c-efa6-4369-a1c9-d0ea3d6f184c service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:33.957556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d11c4c-efa6-4369-a1c9-d0ea3d6f184c service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:33.967291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128ba6f-7960-47dd-9fe9-b9ba0dddfcbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:33.968375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128ba6f-7960-47dd-9fe9-b9ba0dddfcbd service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:33.968880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128ba6f-7960-47dd-9fe9-b9ba0dddfcbd service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:33.969369 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128ba6f-7960-47dd-9fe9-b9ba0dddfcbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:33.972642 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2128ba6f-7960-47dd-9fe9-b9ba0dddfcbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:34.084685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128ba6f-7960-47dd-9fe9-b9ba0dddfcbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:34.086503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128ba6f-7960-47dd-9fe9-b9ba0dddfcbd service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:34.101416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1150/2316] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:39.393379 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=6 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:44.093158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=28 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:51.804169 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ebcc1-98b7-4561-afd9-b0c45e6f61a9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:51.805064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ebcc1-98b7-4561-afd9-b0c45e6f61a9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:51.805064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ebcc1-98b7-4561-afd9-b0c45e6f61a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:51.836057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-624ebcc1-98b7-4561-afd9-b0c45e6f61a9 None None] MFA Rules not processed for user `f447a34300944a5da25f6408f802f602`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:51.838372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-624ebcc1-98b7-4561-afd9-b0c45e6f61a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:51.850270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1167/2317] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:38:52.392690 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128ba6f-7960-47dd-9fe9-b9ba0dddfcbd service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:52.417990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128ba6f-7960-47dd-9fe9-b9ba0dddfcbd service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:52.424078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:52.425047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:52.425712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:52.426137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:52.429189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:52.447482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:52.450049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:52.468023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1151/2318] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:52.921511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ebcc1-98b7-4561-afd9-b0c45e6f61a9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:52.924433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-624ebcc1-98b7-4561-afd9-b0c45e6f61a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:53.042589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:53.045695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:53.077516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14c87-c76b-4ed4-8845-bc52253b3119 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:53.086102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:53.087678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:53.088389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:53.089106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] PATH_INFO: `/v3/users/b985a376cdbd45bf80a3142ffbd81fba` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:53.091483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b985a376cdbd45bf80a3142ffbd81fba)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:53.096103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:53.105995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ebcc1-98b7-4561-afd9-b0c45e6f61a9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:53.121811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9535ef-f4d8-457b-aad3-76f63dc41310 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:53.123088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9535ef-f4d8-457b-aad3-76f63dc41310 service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:53.123938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9535ef-f4d8-457b-aad3-76f63dc41310 service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:53.124646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9535ef-f4d8-457b-aad3-76f63dc41310 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:53.128208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7d9535ef-f4d8-457b-aad3-76f63dc41310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:53.153856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9535ef-f4d8-457b-aad3-76f63dc41310 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:53.157432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9535ef-f4d8-457b-aad3-76f63dc41310 service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:53.180674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1168/2319] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:53.199423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b985a376cdbd45bf80a3142ffbd81fba'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.201841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b985a376cdbd45bf80a3142ffbd81fba'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.202685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b985a376cdbd45bf80a3142ffbd81fba'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.229816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b985a376cdbd45bf80a3142ffbd81fba'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.244845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b985a376cdbd45bf80a3142ffbd81fba'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.266909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1152/2320] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:38:53 2022] DELETE /identity/v3/users/b985a376cdbd45bf80a3142ffbd81fba => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:38:53.453556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9535ef-f4d8-457b-aad3-76f63dc41310 service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:53.474273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9535ef-f4d8-457b-aad3-76f63dc41310 service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:53.600476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:53.601403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:53.601906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:53.602729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:53.606457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:53.614954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:53.615697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:53.641522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:53.644997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:53.666358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1169/2321] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:53.734089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f1a19-1fe7-45c7-a770-aafc686e2a85 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:53.742511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:53.743899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:53.744443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:53.744946 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] PATH_INFO: `/v3/projects/727bfec133af4b0db4dd397ee32fbb2e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:53.747346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727bfec133af4b0db4dd397ee32fbb2e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:53.750906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:53.844265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727bfec133af4b0db4dd397ee32fbb2e', 'request_id': 'req-786386c4-f11c-49b4-b102-c85f64421571'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.856881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727bfec133af4b0db4dd397ee32fbb2e', 'request_id': 'req-786386c4-f11c-49b4-b102-c85f64421571'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.866094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:53.868515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727bfec133af4b0db4dd397ee32fbb2e', 'request_id': 'req-786386c4-f11c-49b4-b102-c85f64421571'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.893593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] The token cache is being invalidate because project 727bfec133af4b0db4dd397ee32fbb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:38:53.894096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.895242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-786386c4-f11c-49b4-b102-c85f64421571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:38:53.897879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1153/2322] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:38:53 2022] DELETE /identity/v3/projects/727bfec133af4b0db4dd397ee32fbb2e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:39:03.655561 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=67 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:03.886882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:04.915224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:04.918112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:05.020415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934c95d-5add-4f53-b879-51577e45828b service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:05.106229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:05.106989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:05.107316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:05.107635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:05.109884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:05.131216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:05.132898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:05.148605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1170/2323] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:06.023618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3f3e8-9959-4d58-850a-d74ff9749f4c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:06.024475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3f3e8-9959-4d58-850a-d74ff9749f4c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:06.024652 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3f3e8-9959-4d58-850a-d74ff9749f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:06.047381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cab3f3e8-9959-4d58-850a-d74ff9749f4c None None] MFA Rules not processed for user `ae4f7f8855b5445d863a825ce921c982`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:06.048673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cab3f3e8-9959-4d58-850a-d74ff9749f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:06.136547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1154/2324] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:39:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:39:06.373604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:06.375583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:06.402979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8d700-f070-4d3e-b5a7-d297d98af52f service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:06.412932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc5f7a-d300-4ec1-b9fe-c86bf7bfd71d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:06.414026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc5f7a-d300-4ec1-b9fe-c86bf7bfd71d service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:06.414423 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc5f7a-d300-4ec1-b9fe-c86bf7bfd71d service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:06.414941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc5f7a-d300-4ec1-b9fe-c86bf7bfd71d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:06.418036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a5bc5f7a-d300-4ec1-b9fe-c86bf7bfd71d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:06.512040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc5f7a-d300-4ec1-b9fe-c86bf7bfd71d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:06.514218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc5f7a-d300-4ec1-b9fe-c86bf7bfd71d service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:06.526443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1171/2325] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:10.669570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3f3e8-9959-4d58-850a-d74ff9749f4c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:10.683230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3f3e8-9959-4d58-850a-d74ff9749f4c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:10.690463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:10.691151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:10.691433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:10.691708 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:10.693730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:10.708961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:10.710606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:10.723304 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1155/2326] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:16.520913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=90 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:20.718231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=31 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:22.793924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb155a13-a9c3-4508-8d63-9f32bb8c91dc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:22.794541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb155a13-a9c3-4508-8d63-9f32bb8c91dc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:22.794766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb155a13-a9c3-4508-8d63-9f32bb8c91dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:22.828020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-eb155a13-a9c3-4508-8d63-9f32bb8c91dc None None] MFA Rules not processed for user `45285b561f424fde9297724c6768250d`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:22.830113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eb155a13-a9c3-4508-8d63-9f32bb8c91dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:22.844499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1172/2327] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:39:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:23.218283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:23.220312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:23.300779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af323c-ca44-4593-bf8e-9ca97df52832 service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:23.305331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:23.306042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:23.306375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:23.306805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:23.309439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:23.321514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:23.323204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:23.333519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1156/2328] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:32.817086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:33.329174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=26 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:39.748265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35ca18-0eb2-41f9-ac6a-95b5b7f58d4a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:39.749258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35ca18-0eb2-41f9-ac6a-95b5b7f58d4a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:39.750177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35ca18-0eb2-41f9-ac6a-95b5b7f58d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:39.785557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-4e35ca18-0eb2-41f9-ac6a-95b5b7f58d4a None None] MFA Rules not processed for user `1507cffe84dc4849a7040333ad48d99c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:39.787846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4e35ca18-0eb2-41f9-ac6a-95b5b7f58d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:39.897375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1173/2329] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:39:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:49.889081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=25 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:24.140460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:24.143646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:24.309977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a9344-a9e8-49f0-bd6b-d39f522d3cd2 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:24.315987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:24.316996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:24.317460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:24.318079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:24.321505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:24.368298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:24.370577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:24.387892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1157/2330] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:34.379407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=45 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:48.225625 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35ca18-0eb2-41f9-ac6a-95b5b7f58d4a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:48.227563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4e35ca18-0eb2-41f9-ac6a-95b5b7f58d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:48.298799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35ca18-0eb2-41f9-ac6a-95b5b7f58d4a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:48.303699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576d33c-7985-4627-85f6-505a7117770c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:48.304464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576d33c-7985-4627-85f6-505a7117770c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:48.304831 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576d33c-7985-4627-85f6-505a7117770c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:48.305190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576d33c-7985-4627-85f6-505a7117770c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:48.307793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9576d33c-7985-4627-85f6-505a7117770c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:48.436755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576d33c-7985-4627-85f6-505a7117770c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:48.439542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576d33c-7985-4627-85f6-505a7117770c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:48.478322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1174/2331] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:55.083880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:55.086373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:55.112599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f5556-3bae-465e-b5fc-585c408a61b3 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:55.121411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:55.122532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:55.123096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:55.123593 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] PATH_INFO: `/v3/users/ae4f7f8855b5445d863a825ce921c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:55.126060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4f7f8855b5445d863a825ce921c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:55.130149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:55.241041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4f7f8855b5445d863a825ce921c982'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:55.242390 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4f7f8855b5445d863a825ce921c982'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:55.243662 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4f7f8855b5445d863a825ce921c982'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:55.271118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4f7f8855b5445d863a825ce921c982'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:55.287265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6882be2-74e2-48d9-a8f3-35ffcc5953e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4f7f8855b5445d863a825ce921c982'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:55.323059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1158/2332] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:40:55 2022] DELETE /identity/v3/users/ae4f7f8855b5445d863a825ce921c982 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:40:55.675564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576d33c-7985-4627-85f6-505a7117770c service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:55.703324 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576d33c-7985-4627-85f6-505a7117770c service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:55.862023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:55.863255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:55.864386 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:55.865092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] PATH_INFO: `/v3/projects/66a102abeb7f46a292a49d1f022190e7` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:55.867929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a102abeb7f46a292a49d1f022190e7)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:55.878123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:55.956062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:55.996486 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a102abeb7f46a292a49d1f022190e7', 'request_id': 'req-c2a67fbf-208e-4529-9ca5-81b693145ea9'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:56.011151 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a102abeb7f46a292a49d1f022190e7', 'request_id': 'req-c2a67fbf-208e-4529-9ca5-81b693145ea9'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:56.029727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a102abeb7f46a292a49d1f022190e7', 'request_id': 'req-c2a67fbf-208e-4529-9ca5-81b693145ea9'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:56.056810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] The token cache is being invalidate because project 66a102abeb7f46a292a49d1f022190e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:40:56.057319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:56.058637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c2a67fbf-208e-4529-9ca5-81b693145ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:40:56.061600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1175/2333] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:40:55 2022] DELETE /identity/v3/projects/66a102abeb7f46a292a49d1f022190e7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:40:56.069228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2df139-7066-4041-85eb-aa9e880d9248 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.069858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2df139-7066-4041-85eb-aa9e880d9248 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.070473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2df139-7066-4041-85eb-aa9e880d9248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.181145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bb2df139-7066-4041-85eb-aa9e880d9248 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:56.183789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bb2df139-7066-4041-85eb-aa9e880d9248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:56.295223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1159/2334] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:56.305279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d643-0827-4988-868e-0a34b3a1f02b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.305697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d643-0827-4988-868e-0a34b3a1f02b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.306117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d643-0827-4988-868e-0a34b3a1f02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.347242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c0d7d643-0827-4988-868e-0a34b3a1f02b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:56.349546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c0d7d643-0827-4988-868e-0a34b3a1f02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:56.365465 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1176/2335] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:56.372219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2df139-7066-4041-85eb-aa9e880d9248 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:56.389798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2df139-7066-4041-85eb-aa9e880d9248 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:56.398333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2dec3-d047-419b-bf0f-12cbb296289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:56.399440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2dec3-d047-419b-bf0f-12cbb296289f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.399925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2dec3-d047-419b-bf0f-12cbb296289f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.400401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2dec3-d047-419b-bf0f-12cbb296289f admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.401646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2dec3-d047-419b-bf0f-12cbb296289f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:40:56.402193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2dec3-d047-419b-bf0f-12cbb296289f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:56.405426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2dec3-d047-419b-bf0f-12cbb296289f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:56.430254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1160/2336] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:40:56.437454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7d643-0827-4988-868e-0a34b3a1f02b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:56.455547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7d643-0827-4988-868e-0a34b3a1f02b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:56.464576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ea1d-8ee1-4db3-afa7-bcff1c260b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:56.465578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ea1d-8ee1-4db3-afa7-bcff1c260b1a admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.466008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ea1d-8ee1-4db3-afa7-bcff1c260b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.466439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ea1d-8ee1-4db3-afa7-bcff1c260b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.467871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2ea1d-8ee1-4db3-afa7-bcff1c260b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:56.471468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2ea1d-8ee1-4db3-afa7-bcff1c260b1a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:56.525581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1177/2337] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:40:56 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:40:56.530483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2dec3-d047-419b-bf0f-12cbb296289f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:56.543071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2dec3-d047-419b-bf0f-12cbb296289f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:56.599537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:56.667005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47e894-0fd4-4fc6-8ef6-7aefee5ef2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:56.667866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47e894-0fd4-4fc6-8ef6-7aefee5ef2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.668192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47e894-0fd4-4fc6-8ef6-7aefee5ef2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.668599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47e894-0fd4-4fc6-8ef6-7aefee5ef2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.669441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47e894-0fd4-4fc6-8ef6-7aefee5ef2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:56.673419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47e894-0fd4-4fc6-8ef6-7aefee5ef2d7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:56.708423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1161/2338] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:40:56 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:40:56.714520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ea1d-8ee1-4db3-afa7-bcff1c260b1a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:56.731310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ea1d-8ee1-4db3-afa7-bcff1c260b1a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:56.738580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0e9a-ad8c-4d63-a887-c44dc031ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:56.740026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0e9a-ad8c-4d63-a887-c44dc031ae93 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.740312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0e9a-ad8c-4d63-a887-c44dc031ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.740723 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0e9a-ad8c-4d63-a887-c44dc031ae93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.741752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0e9a-ad8c-4d63-a887-c44dc031ae93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:56.745411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0e9a-ad8c-4d63-a887-c44dc031ae93 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:56.763624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1178/2339] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:40:56.769071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47e894-0fd4-4fc6-8ef6-7aefee5ef2d7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:56.782407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47e894-0fd4-4fc6-8ef6-7aefee5ef2d7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:56.788585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039048c2-d98e-427f-b14f-fc97481fe600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:56.789475 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039048c2-d98e-427f-b14f-fc97481fe600 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.790108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039048c2-d98e-427f-b14f-fc97481fe600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.790498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039048c2-d98e-427f-b14f-fc97481fe600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.791633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039048c2-d98e-427f-b14f-fc97481fe600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:56.793666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039048c2-d98e-427f-b14f-fc97481fe600 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:56.815274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1162/2340] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:40:56.817313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0e9a-ad8c-4d63-a887-c44dc031ae93 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:56.833522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0e9a-ad8c-4d63-a887-c44dc031ae93 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:56.842085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a20f30-a2d7-41f0-874e-3ea103043a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:56.843041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a20f30-a2d7-41f0-874e-3ea103043a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.843613 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a20f30-a2d7-41f0-874e-3ea103043a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.844788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a20f30-a2d7-41f0-874e-3ea103043a69 admin admin] PATH_INFO: `/v3/projects/0aea3725f5a6427ca1e1c599990f82c8/users/c81dcad2fde84b949f6dbc04ed9f0e11/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.882212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a20f30-a2d7-41f0-874e-3ea103043a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aea3725f5a6427ca1e1c599990f82c8, user_id=c81dcad2fde84b949f6dbc04ed9f0e11, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:56.887827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a20f30-a2d7-41f0-874e-3ea103043a69 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:56.913448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1179/2341] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:40:56 2022] PUT /identity/v3/projects/0aea3725f5a6427ca1e1c599990f82c8/users/c81dcad2fde84b949f6dbc04ed9f0e11/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:40:56.933290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b107-f9e6-4685-9389-2f79c164693a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.933932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b107-f9e6-4685-9389-2f79c164693a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.934377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b107-f9e6-4685-9389-2f79c164693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.976214 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-62d1b107-f9e6-4685-9389-2f79c164693a None None] MFA Rules not processed for user `c81dcad2fde84b949f6dbc04ed9f0e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:56.978543 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-62d1b107-f9e6-4685-9389-2f79c164693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:57.074073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1163/2342] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:57.078980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a20f30-a2d7-41f0-874e-3ea103043a69 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:57.186459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a20f30-a2d7-41f0-874e-3ea103043a69 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:57.192589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8b67-e821-4687-8881-eda52211b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:57.194152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8b67-e821-4687-8881-eda52211b508 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:57.194803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8b67-e821-4687-8881-eda52211b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:57.195793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8b67-e821-4687-8881-eda52211b508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:57.196559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8b67-e821-4687-8881-eda52211b508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:57.198915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8b67-e821-4687-8881-eda52211b508 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:57.245051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1180/2343] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:40:57 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:40:57.249075 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1b107-f9e6-4685-9389-2f79c164693a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:57.265479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1b107-f9e6-4685-9389-2f79c164693a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:57.371319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d763f68-9fec-470c-bff3-2d71490231d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:57.372415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d763f68-9fec-470c-bff3-2d71490231d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:57.372933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d763f68-9fec-470c-bff3-2d71490231d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:57.373424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d763f68-9fec-470c-bff3-2d71490231d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:57.374705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d763f68-9fec-470c-bff3-2d71490231d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:57.378792 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d763f68-9fec-470c-bff3-2d71490231d6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:57.424137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1164/2344] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:40:57 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:40:57.426585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8b67-e821-4687-8881-eda52211b508 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:57.444461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8b67-e821-4687-8881-eda52211b508 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:57.451562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f013c7b-657e-4e0e-8167-4349f147c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:57.452672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f013c7b-657e-4e0e-8167-4349f147c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:57.453153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f013c7b-657e-4e0e-8167-4349f147c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:57.453586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f013c7b-657e-4e0e-8167-4349f147c3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:57.454832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f013c7b-657e-4e0e-8167-4349f147c3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:57.458308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f013c7b-657e-4e0e-8167-4349f147c3d3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:57.473606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1181/2345] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:40:57.479765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d763f68-9fec-470c-bff3-2d71490231d6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:57.491770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d763f68-9fec-470c-bff3-2d71490231d6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:57.497190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c08e2-a276-4c25-ae2d-7daf56dbe7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:57.497938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c08e2-a276-4c25-ae2d-7daf56dbe7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:57.498223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c08e2-a276-4c25-ae2d-7daf56dbe7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:57.498504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c08e2-a276-4c25-ae2d-7daf56dbe7d8 admin admin] PATH_INFO: `/v3/projects/378f6eaf780642e1b1826c9e0fca9ac4/users/458c20115f914b3284b8a9cdb401c03e/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:57.520034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c08e2-a276-4c25-ae2d-7daf56dbe7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378f6eaf780642e1b1826c9e0fca9ac4, user_id=458c20115f914b3284b8a9cdb401c03e, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:57.523784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c08e2-a276-4c25-ae2d-7daf56dbe7d8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:57.543705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1165/2346] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:40:57 2022] PUT /identity/v3/projects/378f6eaf780642e1b1826c9e0fca9ac4/users/458c20115f914b3284b8a9cdb401c03e/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:40:57.548684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f013c7b-657e-4e0e-8167-4349f147c3d3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:57.565604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f013c7b-657e-4e0e-8167-4349f147c3d3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:57.602118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:57.669361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2461d7-090a-4f11-9351-6abb4abdcf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:57.670698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2461d7-090a-4f11-9351-6abb4abdcf38 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:57.671184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2461d7-090a-4f11-9351-6abb4abdcf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:57.671666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2461d7-090a-4f11-9351-6abb4abdcf38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:57.673014 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2461d7-090a-4f11-9351-6abb4abdcf38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:57.678078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2461d7-090a-4f11-9351-6abb4abdcf38 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:57.698870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1182/2347] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:40:57.704775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c08e2-a276-4c25-ae2d-7daf56dbe7d8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:57.712360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:57.724108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c08e2-a276-4c25-ae2d-7daf56dbe7d8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:57.731918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0765c-d8d5-48a0-b2a0-f93a2bc34a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:57.732971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0765c-d8d5-48a0-b2a0-f93a2bc34a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:57.733319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0765c-d8d5-48a0-b2a0-f93a2bc34a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:57.733673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0765c-d8d5-48a0-b2a0-f93a2bc34a46 admin admin] PATH_INFO: `/v3/projects/378f6eaf780642e1b1826c9e0fca9ac4/users/458c20115f914b3284b8a9cdb401c03e/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:57.736272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0765c-d8d5-48a0-b2a0-f93a2bc34a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378f6eaf780642e1b1826c9e0fca9ac4, user_id=458c20115f914b3284b8a9cdb401c03e, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:57.740613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0765c-d8d5-48a0-b2a0-f93a2bc34a46 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:57.764158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1166/2348] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:40:57 2022] PUT /identity/v3/projects/378f6eaf780642e1b1826c9e0fca9ac4/users/458c20115f914b3284b8a9cdb401c03e/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:40:57.777389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11c4d-b4b0-4bef-ae09-ce160d79c86f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:57.778280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11c4d-b4b0-4bef-ae09-ce160d79c86f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:57.778280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11c4d-b4b0-4bef-ae09-ce160d79c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:57.831248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c9c11c4d-b4b0-4bef-ae09-ce160d79c86f None None] MFA Rules not processed for user `458c20115f914b3284b8a9cdb401c03e`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:57.833638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c9c11c4d-b4b0-4bef-ae09-ce160d79c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:57.945505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1183/2349] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:40:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:40:57.964287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0765c-d8d5-48a0-b2a0-f93a2bc34a46 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:57.966781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-eba0765c-d8d5-48a0-b2a0-f93a2bc34a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:58.088665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0765c-d8d5-48a0-b2a0-f93a2bc34a46 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:58.093618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a8d80-bbad-4f0a-b41d-6834c8f38db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:58.094423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8d80-bbad-4f0a-b41d-6834c8f38db3 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:58.094924 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8d80-bbad-4f0a-b41d-6834c8f38db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:58.095383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8d80-bbad-4f0a-b41d-6834c8f38db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:58.109201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a8d80-bbad-4f0a-b41d-6834c8f38db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:58.111289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a8d80-bbad-4f0a-b41d-6834c8f38db3 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:58.130246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1167/2350] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:58.263947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c11c4d-b4b0-4bef-ae09-ce160d79c86f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:58.282005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c11c4d-b4b0-4bef-ae09-ce160d79c86f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:58.288804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996c64d-313b-4f48-b051-5631fc65bc9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:58.289673 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996c64d-313b-4f48-b051-5631fc65bc9c service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:58.290100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996c64d-313b-4f48-b051-5631fc65bc9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:58.290833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996c64d-313b-4f48-b051-5631fc65bc9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:58.390774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996c64d-313b-4f48-b051-5631fc65bc9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:58.392260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996c64d-313b-4f48-b051-5631fc65bc9c service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:58.410109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1184/2351] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:00.231928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b724-ab92-456c-98a5-4497f46537f6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:00.232687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b724-ab92-456c-98a5-4497f46537f6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:00.232891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b724-ab92-456c-98a5-4497f46537f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:00.270347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6a57b724-ab92-456c-98a5-4497f46537f6 None None] MFA Rules not processed for user `f447a34300944a5da25f6408f802f602`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:00.273307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6a57b724-ab92-456c-98a5-4497f46537f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:00.381845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1168/2352] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:08.398219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=79 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:10.368250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:21.499998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996c64d-313b-4f48-b051-5631fc65bc9c service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:21.501915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c996c64d-313b-4f48-b051-5631fc65bc9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:21.658043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996c64d-313b-4f48-b051-5631fc65bc9c service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:21.667493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:21.668592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:21.669161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:21.669540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:21.673119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:21.698602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:21.701817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:21.723017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1185/2353] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:23.284587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373ba27-b452-4290-818b-e3cac3625f89 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:23.285144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373ba27-b452-4290-818b-e3cac3625f89 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:23.285562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373ba27-b452-4290-818b-e3cac3625f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:23.336278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d373ba27-b452-4290-818b-e3cac3625f89 None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:23.337615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d373ba27-b452-4290-818b-e3cac3625f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:23.426307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1169/2354] 10.222.0.78 () {58 vars in 967 bytes} [Wed Aug 24 03:41:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:23.496496 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:23.498481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:23.591956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495635bd-cade-4833-9f3e-3d51bfa1cce8 service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:23.605485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3763f30-617d-442a-b579-17a216549573 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:23.606779 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763f30-617d-442a-b579-17a216549573 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:23.607269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763f30-617d-442a-b579-17a216549573 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:23.607697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763f30-617d-442a-b579-17a216549573 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:23.623198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3763f30-617d-442a-b579-17a216549573 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:23.626115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3763f30-617d-442a-b579-17a216549573 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:23.640072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1186/2355] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:41:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:24.135509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373ba27-b452-4290-818b-e3cac3625f89 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:24.137151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d373ba27-b452-4290-818b-e3cac3625f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:24.229972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373ba27-b452-4290-818b-e3cac3625f89 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:24.235041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79be11d-eba9-4eb6-8cbc-e5ea020a135f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:24.235812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79be11d-eba9-4eb6-8cbc-e5ea020a135f service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:24.236174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79be11d-eba9-4eb6-8cbc-e5ea020a135f service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:24.236571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79be11d-eba9-4eb6-8cbc-e5ea020a135f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:24.239276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e79be11d-eba9-4eb6-8cbc-e5ea020a135f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:24.315225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79be11d-eba9-4eb6-8cbc-e5ea020a135f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:24.317229 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79be11d-eba9-4eb6-8cbc-e5ea020a135f service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:24.328314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1170/2356] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:41:33.440714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3763f30-617d-442a-b579-17a216549573 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:33.442332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c3763f30-617d-442a-b579-17a216549573 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:33.463430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3763f30-617d-442a-b579-17a216549573 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:33.468852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:33.469513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:33.469789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:33.470058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] PATH_INFO: `/v3/users/b829d1bdf9764cefa06ca6f9c5f69296` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:33.471422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b829d1bdf9764cefa06ca6f9c5f69296)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:33.473940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:33.551222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b829d1bdf9764cefa06ca6f9c5f69296'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:33.551933 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b829d1bdf9764cefa06ca6f9c5f69296'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:33.560492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:33.575156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b829d1bdf9764cefa06ca6f9c5f69296'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:33.586906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b829d1bdf9764cefa06ca6f9c5f69296'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:33.600006 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b829d1bdf9764cefa06ca6f9c5f69296'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:33.616394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1187/2357] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:33 2022] DELETE /identity/v3/users/b829d1bdf9764cefa06ca6f9c5f69296 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:33.850633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79be11d-eba9-4eb6-8cbc-e5ea020a135f service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:33.863268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79be11d-eba9-4eb6-8cbc-e5ea020a135f service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:33.919331 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:33.945252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:33.945873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:33.946150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:33.946418 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] PATH_INFO: `/v3/projects/f0af57c134de4e0a888e90e50510d915` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:33.947797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0af57c134de4e0a888e90e50510d915)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:33.949958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:34.024972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0af57c134de4e0a888e90e50510d915', 'request_id': 'req-f429b2f9-933c-46c4-af0a-a64ce1336ec6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.034210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0af57c134de4e0a888e90e50510d915', 'request_id': 'req-f429b2f9-933c-46c4-af0a-a64ce1336ec6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.043570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0af57c134de4e0a888e90e50510d915', 'request_id': 'req-f429b2f9-933c-46c4-af0a-a64ce1336ec6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.060537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] The token cache is being invalidate because project f0af57c134de4e0a888e90e50510d915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:41:34.060932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.061657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.063292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1171/2358] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:41:33 2022] DELETE /identity/v3/projects/f0af57c134de4e0a888e90e50510d915 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:41:34.069024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:34.070605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:34.085959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33519fd1-a4ef-42eb-aaf1-67d093b09aed admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:34.158984 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:34.160210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.160650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.161108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] PATH_INFO: `/v3/users/1032935ff3fb401e9483640a2a89f048` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.162980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1032935ff3fb401e9483640a2a89f048)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:34.165752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:34.242103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1032935ff3fb401e9483640a2a89f048'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.242103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1032935ff3fb401e9483640a2a89f048'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.262300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1032935ff3fb401e9483640a2a89f048'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.271987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1032935ff3fb401e9483640a2a89f048'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.279943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1032935ff3fb401e9483640a2a89f048'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.288433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1188/2359] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:34 2022] DELETE /identity/v3/users/1032935ff3fb401e9483640a2a89f048 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:34.375070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:34.376790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:34.391772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429b2f9-933c-46c4-af0a-a64ce1336ec6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:34.465182 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:34.466091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.466374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.466725 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] PATH_INFO: `/v3/users/c81dcad2fde84b949f6dbc04ed9f0e11` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.468206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81dcad2fde84b949f6dbc04ed9f0e11)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:34.470457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:34.537651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:34.539699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:34.559611 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81dcad2fde84b949f6dbc04ed9f0e11'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.563912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81dcad2fde84b949f6dbc04ed9f0e11'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.565037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81dcad2fde84b949f6dbc04ed9f0e11'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.601382 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190141d-6472-488d-a9c8-98b6f5873a3d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:34.609268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:34.609940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.610215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.610484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] PATH_INFO: `/v3/projects/ab591cbd95e846f0a93b704899245b3f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.614424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab591cbd95e846f0a93b704899245b3f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:34.618982 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:34.625907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81dcad2fde84b949f6dbc04ed9f0e11'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.641937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:34.646184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-30f96741-f5a2-4f3e-9f25-132a3bfa3b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81dcad2fde84b949f6dbc04ed9f0e11'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.669695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1172/2360] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:34 2022] DELETE /identity/v3/users/c81dcad2fde84b949f6dbc04ed9f0e11 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:34.676674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afeb3a-adf1-4faf-980a-f0e7c7f7ffc9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.677303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afeb3a-adf1-4faf-980a-f0e7c7f7ffc9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.677829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afeb3a-adf1-4faf-980a-f0e7c7f7ffc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.692844 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:34.700949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab591cbd95e846f0a93b704899245b3f', 'request_id': 'req-574e9e05-1625-49b6-94ce-57dba91bf36a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.709323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-02afeb3a-adf1-4faf-980a-f0e7c7f7ffc9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:34.711553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-02afeb3a-adf1-4faf-980a-f0e7c7f7ffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:34.715156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab591cbd95e846f0a93b704899245b3f', 'request_id': 'req-574e9e05-1625-49b6-94ce-57dba91bf36a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.734377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab591cbd95e846f0a93b704899245b3f', 'request_id': 'req-574e9e05-1625-49b6-94ce-57dba91bf36a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.752556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] The token cache is being invalidate because project ab591cbd95e846f0a93b704899245b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:41:34.753656 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.753874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:34.755651 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1189/2361] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:41:34 2022] DELETE /identity/v3/projects/ab591cbd95e846f0a93b704899245b3f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:41:34.829507 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1173/2362] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:34.841107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:34.843079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:34.936444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e9e05-1625-49b6-94ce-57dba91bf36a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:34.943124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa3020-c229-4ed3-abcd-3aba1866929c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:34.943973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa3020-c229-4ed3-abcd-3aba1866929c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.944471 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa3020-c229-4ed3-abcd-3aba1866929c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.944931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa3020-c229-4ed3-abcd-3aba1866929c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.959772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa3020-c229-4ed3-abcd-3aba1866929c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:34.962598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa3020-c229-4ed3-abcd-3aba1866929c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:34.981868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1190/2363] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:35.502307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afeb3a-adf1-4faf-980a-f0e7c7f7ffc9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:35.505232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-02afeb3a-adf1-4faf-980a-f0e7c7f7ffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:35.526987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afeb3a-adf1-4faf-980a-f0e7c7f7ffc9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:35.532433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:35.533100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:35.533447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:35.533653 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] PATH_INFO: `/v3/projects/0aea3725f5a6427ca1e1c599990f82c8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:35.535576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aea3725f5a6427ca1e1c599990f82c8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:35.537432 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:35.594232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aea3725f5a6427ca1e1c599990f82c8', 'request_id': 'req-d6654224-87ed-4355-9cc2-f9ea9ddf604d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.602165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aea3725f5a6427ca1e1c599990f82c8', 'request_id': 'req-d6654224-87ed-4355-9cc2-f9ea9ddf604d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.609142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aea3725f5a6427ca1e1c599990f82c8', 'request_id': 'req-d6654224-87ed-4355-9cc2-f9ea9ddf604d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.628305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] The token cache is being invalidate because project 0aea3725f5a6427ca1e1c599990f82c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:41:35.628797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.630045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.632197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1174/2364] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:41:35 2022] DELETE /identity/v3/projects/0aea3725f5a6427ca1e1c599990f82c8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:35.636998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa3020-c229-4ed3-abcd-3aba1866929c service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:35.649220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa3020-c229-4ed3-abcd-3aba1866929c service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:35.716100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:35.716752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:35.717031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:35.717297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] PATH_INFO: `/v3/users/458c20115f914b3284b8a9cdb401c03e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:35.718595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] RBAC: Authorizing `identity:delete_user(user_id=458c20115f914b3284b8a9cdb401c03e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:35.720610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:35.796146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458c20115f914b3284b8a9cdb401c03e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.796890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458c20115f914b3284b8a9cdb401c03e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.814807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458c20115f914b3284b8a9cdb401c03e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.824016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458c20115f914b3284b8a9cdb401c03e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.830763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:35.833321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3a976a64-cd7d-4fcc-bb41-36229157006d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458c20115f914b3284b8a9cdb401c03e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:35.842768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1191/2365] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:35 2022] DELETE /identity/v3/users/458c20115f914b3284b8a9cdb401c03e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:36.232502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:36.234788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:36.255171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6654224-87ed-4355-9cc2-f9ea9ddf604d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:36.338768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:36.340189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.340540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.340889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] PATH_INFO: `/v3/projects/378f6eaf780642e1b1826c9e0fca9ac4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.342307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=378f6eaf780642e1b1826c9e0fca9ac4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:36.344402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:36.364191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:36.409485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378f6eaf780642e1b1826c9e0fca9ac4', 'request_id': 'req-c8cef8ee-daef-4f84-a48d-e84a082e93ee'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:36.419495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378f6eaf780642e1b1826c9e0fca9ac4', 'request_id': 'req-c8cef8ee-daef-4f84-a48d-e84a082e93ee'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:36.429838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378f6eaf780642e1b1826c9e0fca9ac4', 'request_id': 'req-c8cef8ee-daef-4f84-a48d-e84a082e93ee'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:36.447536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] The token cache is being invalidate because project 378f6eaf780642e1b1826c9e0fca9ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:41:36.448147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:36.448982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8cef8ee-daef-4f84-a48d-e84a082e93ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:36.450873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1175/2366] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:41:36 2022] DELETE /identity/v3/projects/378f6eaf780642e1b1826c9e0fca9ac4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:36.457029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c170-5abe-41ed-94cc-d1769b694173 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.457538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c170-5abe-41ed-94cc-d1769b694173 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.458048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c170-5abe-41ed-94cc-d1769b694173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.484894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1946c170-5abe-41ed-94cc-d1769b694173 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:36.486347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1946c170-5abe-41ed-94cc-d1769b694173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:36.568370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1192/2367] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:36.578147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dbbbf-7a7c-4a4a-92b6-05f345063b3e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.579018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dbbbf-7a7c-4a4a-92b6-05f345063b3e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.579018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dbbbf-7a7c-4a4a-92b6-05f345063b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.612787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-961dbbbf-7a7c-4a4a-92b6-05f345063b3e None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:36.615034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-961dbbbf-7a7c-4a4a-92b6-05f345063b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:36.626585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1176/2368] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:36.632245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946c170-5abe-41ed-94cc-d1769b694173 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:36.644122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946c170-5abe-41ed-94cc-d1769b694173 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:36.654892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df3446-c184-45ab-a589-ac81f437ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:36.654892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df3446-c184-45ab-a589-ac81f437ba20 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.654892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df3446-c184-45ab-a589-ac81f437ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.654892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df3446-c184-45ab-a589-ac81f437ba20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.655299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df3446-c184-45ab-a589-ac81f437ba20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:41:36.655299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df3446-c184-45ab-a589-ac81f437ba20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:36.655299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df3446-c184-45ab-a589-ac81f437ba20 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:36.667508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1193/2369] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:41:36.672115 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dbbbf-7a7c-4a4a-92b6-05f345063b3e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:36.682966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dbbbf-7a7c-4a4a-92b6-05f345063b3e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:36.688071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3673c-ccb6-4ebe-8c03-f4fc110a99b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:36.688706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3673c-ccb6-4ebe-8c03-f4fc110a99b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.688976 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3673c-ccb6-4ebe-8c03-f4fc110a99b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.689249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3673c-ccb6-4ebe-8c03-f4fc110a99b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.689939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3673c-ccb6-4ebe-8c03-f4fc110a99b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:36.692073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3673c-ccb6-4ebe-8c03-f4fc110a99b0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:36.730045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1177/2370] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:41:36 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:41:36.735084 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df3446-c184-45ab-a589-ac81f437ba20 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:36.746429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df3446-c184-45ab-a589-ac81f437ba20 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:36.813801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8b0b8-8c98-48eb-b100-ad5a7a404808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:36.814453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8b0b8-8c98-48eb-b100-ad5a7a404808 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.814761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8b0b8-8c98-48eb-b100-ad5a7a404808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.815031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8b0b8-8c98-48eb-b100-ad5a7a404808 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.815803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8b0b8-8c98-48eb-b100-ad5a7a404808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:36.817823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8b0b8-8c98-48eb-b100-ad5a7a404808 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:36.845576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1194/2371] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:41:36 2022] POST /identity/v3/users => generated 282 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:41:36.851790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3673c-ccb6-4ebe-8c03-f4fc110a99b0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:36.864883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3673c-ccb6-4ebe-8c03-f4fc110a99b0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:36.870375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326752e-935b-4274-880e-71c0f8d5a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:36.871080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326752e-935b-4274-880e-71c0f8d5a381 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.871371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326752e-935b-4274-880e-71c0f8d5a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.871638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326752e-935b-4274-880e-71c0f8d5a381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.872335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326752e-935b-4274-880e-71c0f8d5a381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:36.874001 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326752e-935b-4274-880e-71c0f8d5a381 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:36.887362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1178/2372] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:41:36.892173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8b0b8-8c98-48eb-b100-ad5a7a404808 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:36.903785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8b0b8-8c98-48eb-b100-ad5a7a404808 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:36.910281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc6ffb-884f-4f23-98b8-4410d383d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:36.910962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc6ffb-884f-4f23-98b8-4410d383d861 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.911240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc6ffb-884f-4f23-98b8-4410d383d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.911508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc6ffb-884f-4f23-98b8-4410d383d861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.912185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc6ffb-884f-4f23-98b8-4410d383d861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:36.913911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc6ffb-884f-4f23-98b8-4410d383d861 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:36.927639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1195/2373] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:41:36.932882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326752e-935b-4274-880e-71c0f8d5a381 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:36.944827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326752e-935b-4274-880e-71c0f8d5a381 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:36.950324 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d5e8-bbca-4770-9a42-70fc79112b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:36.951080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d5e8-bbca-4770-9a42-70fc79112b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.951365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d5e8-bbca-4770-9a42-70fc79112b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.951645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d5e8-bbca-4770-9a42-70fc79112b3b admin admin] PATH_INFO: `/v3/projects/a4270e84e28344629f536f90e3422039/users/cabdfbed665f419f8838aab38efe4316/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.978112 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d5e8-bbca-4770-9a42-70fc79112b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4270e84e28344629f536f90e3422039, user_id=cabdfbed665f419f8838aab38efe4316, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:36.983699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d5e8-bbca-4770-9a42-70fc79112b3b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:37.006559 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1179/2374] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:41:36 2022] PUT /identity/v3/projects/a4270e84e28344629f536f90e3422039/users/cabdfbed665f419f8838aab38efe4316/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:37.021102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38708-8e6e-4d87-a9db-ddf67b92a3e5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.021620 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38708-8e6e-4d87-a9db-ddf67b92a3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.022042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38708-8e6e-4d87-a9db-ddf67b92a3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.075497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-05d38708-8e6e-4d87-a9db-ddf67b92a3e5 None None] MFA Rules not processed for user `cabdfbed665f419f8838aab38efe4316`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:37.076965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-05d38708-8e6e-4d87-a9db-ddf67b92a3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:37.147173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:37.179062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1196/2375] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:37.181518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d5e8-bbca-4770-9a42-70fc79112b3b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:37.280607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d5e8-bbca-4770-9a42-70fc79112b3b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:37.286449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5e5b6-38f7-440d-aaf9-6ba803bf3012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:37.287205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e5b6-38f7-440d-aaf9-6ba803bf3012 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.287571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e5b6-38f7-440d-aaf9-6ba803bf3012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.288012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e5b6-38f7-440d-aaf9-6ba803bf3012 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.288813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5e5b6-38f7-440d-aaf9-6ba803bf3012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:37.291454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5e5b6-38f7-440d-aaf9-6ba803bf3012 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:37.327972 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1180/2376] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:41:37 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:41:37.333171 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38708-8e6e-4d87-a9db-ddf67b92a3e5 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:37.348248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38708-8e6e-4d87-a9db-ddf67b92a3e5 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:37.444796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed744d1-e568-4ac4-9738-9033af98dd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:37.445463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed744d1-e568-4ac4-9738-9033af98dd4a admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.445751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed744d1-e568-4ac4-9738-9033af98dd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.446034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed744d1-e568-4ac4-9738-9033af98dd4a admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.446875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed744d1-e568-4ac4-9738-9033af98dd4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:37.448951 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed744d1-e568-4ac4-9738-9033af98dd4a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:37.480728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1197/2377] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:41:37 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:41:37.482423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5e5b6-38f7-440d-aaf9-6ba803bf3012 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:37.496564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5e5b6-38f7-440d-aaf9-6ba803bf3012 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:37.503134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12592342-b038-4c8d-9396-713a465df1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:37.504018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12592342-b038-4c8d-9396-713a465df1ca admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.504465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12592342-b038-4c8d-9396-713a465df1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.504863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12592342-b038-4c8d-9396-713a465df1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.505757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12592342-b038-4c8d-9396-713a465df1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:37.507928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12592342-b038-4c8d-9396-713a465df1ca admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:37.528648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1181/2378] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:41:37.530636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed744d1-e568-4ac4-9738-9033af98dd4a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:37.546239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed744d1-e568-4ac4-9738-9033af98dd4a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:37.556520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9e6e9-8953-413c-b75b-2c1f8e9558ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:37.557692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9e6e9-8953-413c-b75b-2c1f8e9558ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.558205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9e6e9-8953-413c-b75b-2c1f8e9558ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.558733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9e6e9-8953-413c-b75b-2c1f8e9558ff admin admin] PATH_INFO: `/v3/projects/8f3f4e40aadb4126ab84a8ad90dfb93c/users/d4660814522b4e97ba0251c33614b59b/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.587303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9e6e9-8953-413c-b75b-2c1f8e9558ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3f4e40aadb4126ab84a8ad90dfb93c, user_id=d4660814522b4e97ba0251c33614b59b, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:37.592886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9e6e9-8953-413c-b75b-2c1f8e9558ff admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:37.613850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1198/2379] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:41:37 2022] PUT /identity/v3/projects/8f3f4e40aadb4126ab84a8ad90dfb93c/users/d4660814522b4e97ba0251c33614b59b/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:37.619882 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12592342-b038-4c8d-9396-713a465df1ca admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:37.631977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12592342-b038-4c8d-9396-713a465df1ca admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:37.643951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:37.734103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b47bd5-3a01-47b4-86e2-8deb6bda1efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:37.735148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b47bd5-3a01-47b4-86e2-8deb6bda1efe admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.735780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b47bd5-3a01-47b4-86e2-8deb6bda1efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.736222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b47bd5-3a01-47b4-86e2-8deb6bda1efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.737483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b47bd5-3a01-47b4-86e2-8deb6bda1efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:37.740546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b47bd5-3a01-47b4-86e2-8deb6bda1efe admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:37.763191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1182/2380] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:41:37.769437 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9e6e9-8953-413c-b75b-2c1f8e9558ff admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:37.794628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9e6e9-8953-413c-b75b-2c1f8e9558ff admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:37.803954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba18b-8cf2-431e-bc61-40d256d7f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:37.805104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba18b-8cf2-431e-bc61-40d256d7f75f admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.805612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba18b-8cf2-431e-bc61-40d256d7f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.806413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba18b-8cf2-431e-bc61-40d256d7f75f admin admin] PATH_INFO: `/v3/projects/8f3f4e40aadb4126ab84a8ad90dfb93c/users/d4660814522b4e97ba0251c33614b59b/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.809057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efba18b-8cf2-431e-bc61-40d256d7f75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3f4e40aadb4126ab84a8ad90dfb93c, user_id=d4660814522b4e97ba0251c33614b59b, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:37.812585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efba18b-8cf2-431e-bc61-40d256d7f75f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:37.828800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1199/2381] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:41:37 2022] PUT /identity/v3/projects/8f3f4e40aadb4126ab84a8ad90dfb93c/users/d4660814522b4e97ba0251c33614b59b/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:37.841457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176aed1-9462-4e9a-8129-4daef52c8142 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.841824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176aed1-9462-4e9a-8129-4daef52c8142 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.842021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176aed1-9462-4e9a-8129-4daef52c8142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.888596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8176aed1-9462-4e9a-8129-4daef52c8142 None None] MFA Rules not processed for user `d4660814522b4e97ba0251c33614b59b`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:37.890800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8176aed1-9462-4e9a-8129-4daef52c8142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:38.012087 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1183/2382] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:38.031480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba18b-8cf2-431e-bc61-40d256d7f75f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:38.034270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2efba18b-8cf2-431e-bc61-40d256d7f75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:38.131538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba18b-8cf2-431e-bc61-40d256d7f75f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:38.138283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b21b-da7f-4a49-83c8-63e015c3abcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:38.139333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b21b-da7f-4a49-83c8-63e015c3abcb service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:38.139797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b21b-da7f-4a49-83c8-63e015c3abcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:38.140258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b21b-da7f-4a49-83c8-63e015c3abcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:38.161657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b21b-da7f-4a49-83c8-63e015c3abcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:38.167632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b21b-da7f-4a49-83c8-63e015c3abcb service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:38.192780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1200/2383] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:38.288478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176aed1-9462-4e9a-8129-4daef52c8142 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:38.290305 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8176aed1-9462-4e9a-8129-4daef52c8142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:38.304685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176aed1-9462-4e9a-8129-4daef52c8142 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:38.308894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336d724-c287-4f4e-9185-1d0b2f2ee863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:38.309531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d724-c287-4f4e-9185-1d0b2f2ee863 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:38.309830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d724-c287-4f4e-9185-1d0b2f2ee863 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:38.310099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d724-c287-4f4e-9185-1d0b2f2ee863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:38.380183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336d724-c287-4f4e-9185-1d0b2f2ee863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:38.381754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336d724-c287-4f4e-9185-1d0b2f2ee863 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:38.392787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1184/2384] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:41.372493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b21b-da7f-4a49-83c8-63e015c3abcb service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:41.465663 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:41.491132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b21b-da7f-4a49-83c8-63e015c3abcb service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:41.498367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:41.499777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:41.499777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:41.499777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] PATH_INFO: `/v3/users/cabdfbed665f419f8838aab38efe4316` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:41.501075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cabdfbed665f419f8838aab38efe4316)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:41.503332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:41.625818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cabdfbed665f419f8838aab38efe4316'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:41.628195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cabdfbed665f419f8838aab38efe4316'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:41.659113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cabdfbed665f419f8838aab38efe4316'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:41.682979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cabdfbed665f419f8838aab38efe4316'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:41.697312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cabdfbed665f419f8838aab38efe4316'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:41.710507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1201/2385] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:41 2022] DELETE /identity/v3/users/cabdfbed665f419f8838aab38efe4316 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:41.717044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e188b-2468-4244-ab14-dff233801e6c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:41.717937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e188b-2468-4244-ab14-dff233801e6c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:41.717937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e188b-2468-4244-ab14-dff233801e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:41.754360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-541e188b-2468-4244-ab14-dff233801e6c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:41.756322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-541e188b-2468-4244-ab14-dff233801e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:41.842955 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:41.908336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1185/2386] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:41.922909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:41.928242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:42.029522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45f1d5-ee20-42a7-83d0-bf9244f2393f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:42.035183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61b2c9-53f4-40e8-87df-320c13babc73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:42.036271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61b2c9-53f4-40e8-87df-320c13babc73 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:42.036719 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61b2c9-53f4-40e8-87df-320c13babc73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:42.037204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61b2c9-53f4-40e8-87df-320c13babc73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:42.058599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61b2c9-53f4-40e8-87df-320c13babc73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:42.061505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61b2c9-53f4-40e8-87df-320c13babc73 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:42.081919 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1202/2387] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:42.567060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e188b-2468-4244-ab14-dff233801e6c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:42.568764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-541e188b-2468-4244-ab14-dff233801e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:42.598515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e188b-2468-4244-ab14-dff233801e6c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:42.604675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:42.605349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:42.605615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:42.605883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] PATH_INFO: `/v3/projects/a4270e84e28344629f536f90e3422039` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:42.610744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4270e84e28344629f536f90e3422039)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:42.610744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:42.680584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4270e84e28344629f536f90e3422039', 'request_id': 'req-e90df7b4-3097-4f9c-b652-453c4c4ab022'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.689413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4270e84e28344629f536f90e3422039', 'request_id': 'req-e90df7b4-3097-4f9c-b652-453c4c4ab022'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.698201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4270e84e28344629f536f90e3422039', 'request_id': 'req-e90df7b4-3097-4f9c-b652-453c4c4ab022'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.715640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] The token cache is being invalidate because project a4270e84e28344629f536f90e3422039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:41:42.715957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.716628 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.724146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1186/2388] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:41:42 2022] DELETE /identity/v3/projects/a4270e84e28344629f536f90e3422039 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:41:42.729399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61b2c9-53f4-40e8-87df-320c13babc73 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:42.741805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61b2c9-53f4-40e8-87df-320c13babc73 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:42.809588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:42.810331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:42.810688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:42.811001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] PATH_INFO: `/v3/users/d4660814522b4e97ba0251c33614b59b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:42.812349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4660814522b4e97ba0251c33614b59b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:42.814398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:42.828797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:42.896916 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4660814522b4e97ba0251c33614b59b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.897619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4660814522b4e97ba0251c33614b59b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.914498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4660814522b4e97ba0251c33614b59b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.927213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4660814522b4e97ba0251c33614b59b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.941154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f9cf33e7-b707-4c8e-80c7-7ea13eb4ba08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4660814522b4e97ba0251c33614b59b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:42.950727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1203/2389] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:42 2022] DELETE /identity/v3/users/d4660814522b4e97ba0251c33614b59b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:43.426334 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:43.429298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:43.453347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df7b4-3097-4f9c-b652-453c4c4ab022 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:43.532323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:43.533099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:43.533389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:43.533770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] PATH_INFO: `/v3/projects/8f3f4e40aadb4126ab84a8ad90dfb93c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:43.535271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3f4e40aadb4126ab84a8ad90dfb93c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:43.537640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:43.616745 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3f4e40aadb4126ab84a8ad90dfb93c', 'request_id': 'req-c8f827f1-8d71-49a2-be07-5b014eae89bb'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:43.625026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3f4e40aadb4126ab84a8ad90dfb93c', 'request_id': 'req-c8f827f1-8d71-49a2-be07-5b014eae89bb'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:43.629776 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:43.633076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3f4e40aadb4126ab84a8ad90dfb93c', 'request_id': 'req-c8f827f1-8d71-49a2-be07-5b014eae89bb'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:43.655063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] The token cache is being invalidate because project 8f3f4e40aadb4126ab84a8ad90dfb93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:41:43.655371 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:43.656088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c8f827f1-8d71-49a2-be07-5b014eae89bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:43.657669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1187/2390] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:41:43 2022] DELETE /identity/v3/projects/8f3f4e40aadb4126ab84a8ad90dfb93c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:43.665118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f02d3-12bf-44c4-a9c9-2aa665cffa05 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:43.665649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f02d3-12bf-44c4-a9c9-2aa665cffa05 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:43.666168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f02d3-12bf-44c4-a9c9-2aa665cffa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:43.696297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-880f02d3-12bf-44c4-a9c9-2aa665cffa05 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:43.697825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-880f02d3-12bf-44c4-a9c9-2aa665cffa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:43.772237 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1204/2391] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:43.780895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cce36-0c24-49d6-88cc-cfb5313db264 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:43.781466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cce36-0c24-49d6-88cc-cfb5313db264 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:43.781466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cce36-0c24-49d6-88cc-cfb5313db264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:43.804466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a09cce36-0c24-49d6-88cc-cfb5313db264 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:43.806144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a09cce36-0c24-49d6-88cc-cfb5313db264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:43.815533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1188/2392] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:43.821259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f02d3-12bf-44c4-a9c9-2aa665cffa05 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:43.836887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f02d3-12bf-44c4-a9c9-2aa665cffa05 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:43.845173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514542ae-f654-4dfb-b04b-555c52f3f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:43.846348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514542ae-f654-4dfb-b04b-555c52f3f3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:43.846889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514542ae-f654-4dfb-b04b-555c52f3f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:43.847378 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514542ae-f654-4dfb-b04b-555c52f3f3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:43.848853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514542ae-f654-4dfb-b04b-555c52f3f3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:41:43.849406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514542ae-f654-4dfb-b04b-555c52f3f3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:43.852693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514542ae-f654-4dfb-b04b-555c52f3f3a8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:43.869165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1205/2393] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:41:43.874203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cce36-0c24-49d6-88cc-cfb5313db264 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:43.888034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cce36-0c24-49d6-88cc-cfb5313db264 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:43.893630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2a45a-7415-4e90-95d0-9c03ed40ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:43.894354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2a45a-7415-4e90-95d0-9c03ed40ad23 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:43.894629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2a45a-7415-4e90-95d0-9c03ed40ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:43.894943 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2a45a-7415-4e90-95d0-9c03ed40ad23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:43.895652 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2a45a-7415-4e90-95d0-9c03ed40ad23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:43.897673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2a45a-7415-4e90-95d0-9c03ed40ad23 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:43.933876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1189/2394] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:41:43 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:41:43.940158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514542ae-f654-4dfb-b04b-555c52f3f3a8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:43.952055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514542ae-f654-4dfb-b04b-555c52f3f3a8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.016049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a07e28-5c16-4caa-a162-d1974876c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.016704 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07e28-5c16-4caa-a162-d1974876c91c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.016980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07e28-5c16-4caa-a162-d1974876c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.017235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07e28-5c16-4caa-a162-d1974876c91c admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.017903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a07e28-5c16-4caa-a162-d1974876c91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.020188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a07e28-5c16-4caa-a162-d1974876c91c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.048077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1206/2395] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:41:43 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:41:44.052727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2a45a-7415-4e90-95d0-9c03ed40ad23 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.064635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2a45a-7415-4e90-95d0-9c03ed40ad23 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.070453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a675b04-8d47-42e5-a950-bba31503e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.070895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a675b04-8d47-42e5-a950-bba31503e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.071176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a675b04-8d47-42e5-a950-bba31503e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.071454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a675b04-8d47-42e5-a950-bba31503e6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.072158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a675b04-8d47-42e5-a950-bba31503e6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.073849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a675b04-8d47-42e5-a950-bba31503e6ab admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.087309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1190/2396] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:41:44.092541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a07e28-5c16-4caa-a162-d1974876c91c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.099588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:44.104220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a07e28-5c16-4caa-a162-d1974876c91c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.111954 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c164e7a-3b6e-4080-88dc-8182286e45f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.112847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164e7a-3b6e-4080-88dc-8182286e45f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.113555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164e7a-3b6e-4080-88dc-8182286e45f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.113822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164e7a-3b6e-4080-88dc-8182286e45f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.114795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c164e7a-3b6e-4080-88dc-8182286e45f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.116728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c164e7a-3b6e-4080-88dc-8182286e45f4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.130278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1207/2397] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:41:44.134579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a675b04-8d47-42e5-a950-bba31503e6ab admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.149716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a675b04-8d47-42e5-a950-bba31503e6ab admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.155903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460977c-e7ae-44ac-aa1e-e4722c7fc762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.155903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460977c-e7ae-44ac-aa1e-e4722c7fc762 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.155903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460977c-e7ae-44ac-aa1e-e4722c7fc762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.156373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460977c-e7ae-44ac-aa1e-e4722c7fc762 admin admin] PATH_INFO: `/v3/projects/8ad5c44138dd46d68fc7bf7cc1b257b3/users/7f69aa8122f6403da951304cfecadf17/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.174104 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460977c-e7ae-44ac-aa1e-e4722c7fc762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad5c44138dd46d68fc7bf7cc1b257b3, user_id=7f69aa8122f6403da951304cfecadf17, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.178381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460977c-e7ae-44ac-aa1e-e4722c7fc762 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.194431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1191/2398] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:41:44 2022] PUT /identity/v3/projects/8ad5c44138dd46d68fc7bf7cc1b257b3/users/7f69aa8122f6403da951304cfecadf17/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:41:44.205398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c26eb5-290b-499f-9c1a-01c209f269e5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.205811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c26eb5-290b-499f-9c1a-01c209f269e5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.206206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c26eb5-290b-499f-9c1a-01c209f269e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.238087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-19c26eb5-290b-499f-9c1a-01c209f269e5 None None] MFA Rules not processed for user `7f69aa8122f6403da951304cfecadf17`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:44.239399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-19c26eb5-290b-499f-9c1a-01c209f269e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:44.315939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1208/2399] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:44.318981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460977c-e7ae-44ac-aa1e-e4722c7fc762 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.391110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460977c-e7ae-44ac-aa1e-e4722c7fc762 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.396016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398b99-f5e1-464d-9c88-7b9b4dfb2ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.396637 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398b99-f5e1-464d-9c88-7b9b4dfb2ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.396916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398b99-f5e1-464d-9c88-7b9b4dfb2ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.397195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398b99-f5e1-464d-9c88-7b9b4dfb2ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.397847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93398b99-f5e1-464d-9c88-7b9b4dfb2ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.399863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93398b99-f5e1-464d-9c88-7b9b4dfb2ec3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.433206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1192/2400] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:41:44 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:41:44.437873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c26eb5-290b-499f-9c1a-01c209f269e5 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.450522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c26eb5-290b-499f-9c1a-01c209f269e5 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.521147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f32963-fca3-45f3-9512-21631b4f7370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.521961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f32963-fca3-45f3-9512-21631b4f7370 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.522283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f32963-fca3-45f3-9512-21631b4f7370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.522583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f32963-fca3-45f3-9512-21631b4f7370 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.523377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f32963-fca3-45f3-9512-21631b4f7370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.525637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f32963-fca3-45f3-9512-21631b4f7370 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.553465 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1209/2401] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:41:44 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:41:44.558674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398b99-f5e1-464d-9c88-7b9b4dfb2ec3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.573771 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398b99-f5e1-464d-9c88-7b9b4dfb2ec3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.580524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067b63-6b4b-420f-96cf-01cde0d46338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.582098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067b63-6b4b-420f-96cf-01cde0d46338 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.582626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067b63-6b4b-420f-96cf-01cde0d46338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.583120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067b63-6b4b-420f-96cf-01cde0d46338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.584352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc067b63-6b4b-420f-96cf-01cde0d46338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.586379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc067b63-6b4b-420f-96cf-01cde0d46338 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.601809 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1193/2402] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:41:44.607090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f32963-fca3-45f3-9512-21631b4f7370 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.619490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f32963-fca3-45f3-9512-21631b4f7370 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.625269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52110-7a91-495b-90aa-39325ffbad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.626005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52110-7a91-495b-90aa-39325ffbad27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.626286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52110-7a91-495b-90aa-39325ffbad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.626565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52110-7a91-495b-90aa-39325ffbad27 admin admin] PATH_INFO: `/v3/projects/3ad4a4e7fce34474862af25b8dd28866/users/ed199c91b7f745f086ef6548face8fa7/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.647174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a52110-7a91-495b-90aa-39325ffbad27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad4a4e7fce34474862af25b8dd28866, user_id=ed199c91b7f745f086ef6548face8fa7, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.649966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a52110-7a91-495b-90aa-39325ffbad27 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.667246 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1210/2403] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:41:44 2022] PUT /identity/v3/projects/3ad4a4e7fce34474862af25b8dd28866/users/ed199c91b7f745f086ef6548face8fa7/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:44.671965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067b63-6b4b-420f-96cf-01cde0d46338 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.685116 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067b63-6b4b-420f-96cf-01cde0d46338 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.757953 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:44.766734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bec936-b6d3-4f43-a255-3ba37f63fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.767634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bec936-b6d3-4f43-a255-3ba37f63fb03 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.768064 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bec936-b6d3-4f43-a255-3ba37f63fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.769303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bec936-b6d3-4f43-a255-3ba37f63fb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.770395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bec936-b6d3-4f43-a255-3ba37f63fb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.772494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bec936-b6d3-4f43-a255-3ba37f63fb03 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.785793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1194/2404] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:41:44.791069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52110-7a91-495b-90aa-39325ffbad27 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.806338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52110-7a91-495b-90aa-39325ffbad27 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.814721 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fb4fb-199f-4742-8975-e3cc60e91e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.816955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb4fb-199f-4742-8975-e3cc60e91e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.817438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb4fb-199f-4742-8975-e3cc60e91e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.817911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb4fb-199f-4742-8975-e3cc60e91e23 admin admin] PATH_INFO: `/v3/projects/3ad4a4e7fce34474862af25b8dd28866/users/ed199c91b7f745f086ef6548face8fa7/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.821519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fb4fb-199f-4742-8975-e3cc60e91e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad4a4e7fce34474862af25b8dd28866, user_id=ed199c91b7f745f086ef6548face8fa7, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.826828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fb4fb-199f-4742-8975-e3cc60e91e23 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.842813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1211/2405] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:41:44 2022] PUT /identity/v3/projects/3ad4a4e7fce34474862af25b8dd28866/users/ed199c91b7f745f086ef6548face8fa7/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:44.862723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b51e-6905-42f4-a31f-fa460d58947c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.863061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b51e-6905-42f4-a31f-fa460d58947c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.863348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b51e-6905-42f4-a31f-fa460d58947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.897449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a5c0b51e-6905-42f4-a31f-fa460d58947c None None] MFA Rules not processed for user `ed199c91b7f745f086ef6548face8fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:44.899493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a5c0b51e-6905-42f4-a31f-fa460d58947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:44.998979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1195/2406] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:45.012479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fb4fb-199f-4742-8975-e3cc60e91e23 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:45.015350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2e0fb4fb-199f-4742-8975-e3cc60e91e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:45.068886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:45.098905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fb4fb-199f-4742-8975-e3cc60e91e23 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:45.104878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df7fe-7024-4541-8216-7e338b68130f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:45.105518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df7fe-7024-4541-8216-7e338b68130f service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:45.105788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df7fe-7024-4541-8216-7e338b68130f service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:45.106053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df7fe-7024-4541-8216-7e338b68130f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:45.116941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12df7fe-7024-4541-8216-7e338b68130f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:45.118398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12df7fe-7024-4541-8216-7e338b68130f service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:45.130624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1212/2407] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:46.955269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0b51e-6905-42f4-a31f-fa460d58947c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:47.062945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0b51e-6905-42f4-a31f-fa460d58947c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:47.068373 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:47.069107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:47.069393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:47.069778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] PATH_INFO: `/v3/users/7f69aa8122f6403da951304cfecadf17` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:47.071110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f69aa8122f6403da951304cfecadf17)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:47.073158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:47.140302 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f69aa8122f6403da951304cfecadf17'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:47.141251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f69aa8122f6403da951304cfecadf17'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:47.142404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f69aa8122f6403da951304cfecadf17'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:47.159463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f69aa8122f6403da951304cfecadf17'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:47.168050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f69aa8122f6403da951304cfecadf17'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:47.181623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:47.190550 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1196/2408] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:46 2022] DELETE /identity/v3/users/7f69aa8122f6403da951304cfecadf17 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:47.196871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978552ac-fcde-4ece-aa19-c37b60ef1c75 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:47.197464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978552ac-fcde-4ece-aa19-c37b60ef1c75 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:47.197964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978552ac-fcde-4ece-aa19-c37b60ef1c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:47.219971 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-978552ac-fcde-4ece-aa19-c37b60ef1c75 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:47.221234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-978552ac-fcde-4ece-aa19-c37b60ef1c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:47.319891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1213/2409] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:47.335848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:47.338218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:47.505941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c63d7-29c3-47b2-85eb-85e6c11e680f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:47.524404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd485431-2601-47b3-9b43-4f9504d984cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:47.529002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd485431-2601-47b3-9b43-4f9504d984cc service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:47.530282 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd485431-2601-47b3-9b43-4f9504d984cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:47.532096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd485431-2601-47b3-9b43-4f9504d984cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:47.558345 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd485431-2601-47b3-9b43-4f9504d984cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:47.559431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd485431-2601-47b3-9b43-4f9504d984cc service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:47.572907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1197/2410] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:41:47.992468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978552ac-fcde-4ece-aa19-c37b60ef1c75 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:47.992782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-978552ac-fcde-4ece-aa19-c37b60ef1c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:48.014015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978552ac-fcde-4ece-aa19-c37b60ef1c75 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:48.020008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:48.020751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:48.021430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:48.021956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] PATH_INFO: `/v3/projects/8ad5c44138dd46d68fc7bf7cc1b257b3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:48.023511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad5c44138dd46d68fc7bf7cc1b257b3)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:48.025537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:48.109399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad5c44138dd46d68fc7bf7cc1b257b3', 'request_id': 'req-e835260e-3b4e-4322-9907-9a43aceae8e4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.120984 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad5c44138dd46d68fc7bf7cc1b257b3', 'request_id': 'req-e835260e-3b4e-4322-9907-9a43aceae8e4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.131715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad5c44138dd46d68fc7bf7cc1b257b3', 'request_id': 'req-e835260e-3b4e-4322-9907-9a43aceae8e4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.159452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] The token cache is being invalidate because project 8ad5c44138dd46d68fc7bf7cc1b257b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:41:48.159964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.162077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.168795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1214/2411] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:41:47 2022] DELETE /identity/v3/projects/8ad5c44138dd46d68fc7bf7cc1b257b3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:48.171234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd485431-2601-47b3-9b43-4f9504d984cc service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:48.192393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd485431-2601-47b3-9b43-4f9504d984cc service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:48.284116 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:48.284711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:48.285019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:48.285298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] PATH_INFO: `/v3/users/ed199c91b7f745f086ef6548face8fa7` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:48.286975 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed199c91b7f745f086ef6548face8fa7)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:48.289835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:48.363805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed199c91b7f745f086ef6548face8fa7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.364779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed199c91b7f745f086ef6548face8fa7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.365508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed199c91b7f745f086ef6548face8fa7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.386435 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed199c91b7f745f086ef6548face8fa7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.398101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-90b3ddf0-e4da-4829-b148-d89ebf1c58c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed199c91b7f745f086ef6548face8fa7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:48.420605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1198/2412] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:48 2022] DELETE /identity/v3/users/ed199c91b7f745f086ef6548face8fa7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:49.037817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:49.040464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:49.099351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835260e-3b4e-4322-9907-9a43aceae8e4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:49.241579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:49.243472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:49.243994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:49.244512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] PATH_INFO: `/v3/projects/3ad4a4e7fce34474862af25b8dd28866` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:49.246908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad4a4e7fce34474862af25b8dd28866)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:49.253482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:49.260658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:49.373974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad4a4e7fce34474862af25b8dd28866', 'request_id': 'req-bdda908a-0b62-4a61-84c1-243efb069306'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:49.390211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad4a4e7fce34474862af25b8dd28866', 'request_id': 'req-bdda908a-0b62-4a61-84c1-243efb069306'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:49.405454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad4a4e7fce34474862af25b8dd28866', 'request_id': 'req-bdda908a-0b62-4a61-84c1-243efb069306'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:49.430239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] The token cache is being invalidate because project 3ad4a4e7fce34474862af25b8dd28866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:41:49.431244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:49.432510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-bdda908a-0b62-4a61-84c1-243efb069306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:49.440299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1215/2413] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:41:49 2022] DELETE /identity/v3/projects/3ad4a4e7fce34474862af25b8dd28866 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:41:49.445145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b79e3c-6c23-4838-93f5-ef1117888f96 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:49.446025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b79e3c-6c23-4838-93f5-ef1117888f96 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:49.446025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b79e3c-6c23-4838-93f5-ef1117888f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:49.485741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-20b79e3c-6c23-4838-93f5-ef1117888f96 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:49.488395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-20b79e3c-6c23-4838-93f5-ef1117888f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:49.519769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:49.589603 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1199/2414] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:49.602504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52692b2d-ecce-416f-b9a3-a156d3881cc7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:49.602987 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52692b2d-ecce-416f-b9a3-a156d3881cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:49.603286 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52692b2d-ecce-416f-b9a3-a156d3881cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:49.631968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-52692b2d-ecce-416f-b9a3-a156d3881cc7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:49.633231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-52692b2d-ecce-416f-b9a3-a156d3881cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:49.642331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1216/2415] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:49.648245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b79e3c-6c23-4838-93f5-ef1117888f96 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:49.659739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b79e3c-6c23-4838-93f5-ef1117888f96 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:49.665319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc186c-9096-4e2a-860f-1ee947afbc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:49.666004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc186c-9096-4e2a-860f-1ee947afbc95 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:49.666284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc186c-9096-4e2a-860f-1ee947afbc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:49.666564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc186c-9096-4e2a-860f-1ee947afbc95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:49.667375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc186c-9096-4e2a-860f-1ee947afbc95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:41:49.667695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc186c-9096-4e2a-860f-1ee947afbc95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:49.669485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc186c-9096-4e2a-860f-1ee947afbc95 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:49.686793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1200/2416] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:41:49.692459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52692b2d-ecce-416f-b9a3-a156d3881cc7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:49.703541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52692b2d-ecce-416f-b9a3-a156d3881cc7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:49.709909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7d80-cf4c-4277-8646-c5943b06fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:49.710690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7d80-cf4c-4277-8646-c5943b06fbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:49.711056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7d80-cf4c-4277-8646-c5943b06fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:49.711391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7d80-cf4c-4277-8646-c5943b06fbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:49.712300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f7d80-cf4c-4277-8646-c5943b06fbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:49.715966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f7d80-cf4c-4277-8646-c5943b06fbe6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:49.760551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1217/2417] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:41:49 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:41:49.764796 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc186c-9096-4e2a-860f-1ee947afbc95 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:49.780314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc186c-9096-4e2a-860f-1ee947afbc95 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:49.898382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73d25b-7473-4034-b928-6069d2ebe318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:49.899673 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73d25b-7473-4034-b928-6069d2ebe318 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:49.900186 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73d25b-7473-4034-b928-6069d2ebe318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:49.900920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73d25b-7473-4034-b928-6069d2ebe318 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:49.902196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73d25b-7473-4034-b928-6069d2ebe318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:49.907146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73d25b-7473-4034-b928-6069d2ebe318 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:49.947927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1201/2418] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:41:49 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:41:49.960929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7d80-cf4c-4277-8646-c5943b06fbe6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:49.974918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7d80-cf4c-4277-8646-c5943b06fbe6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:49.980382 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893e96-c899-489c-8698-049bf0f46cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:49.981929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893e96-c899-489c-8698-049bf0f46cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:49.982415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893e96-c899-489c-8698-049bf0f46cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:49.982828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893e96-c899-489c-8698-049bf0f46cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:49.983715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd893e96-c899-489c-8698-049bf0f46cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:49.985598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd893e96-c899-489c-8698-049bf0f46cf1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:50.001575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1218/2419] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:41:50.008217 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73d25b-7473-4034-b928-6069d2ebe318 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:50.024807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73d25b-7473-4034-b928-6069d2ebe318 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:50.032790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfc2bc-b365-45d6-9a1d-3184b56618c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:50.033900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc2bc-b365-45d6-9a1d-3184b56618c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.034333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc2bc-b365-45d6-9a1d-3184b56618c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.034737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc2bc-b365-45d6-9a1d-3184b56618c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.035456 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfc2bc-b365-45d6-9a1d-3184b56618c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:50.037168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfc2bc-b365-45d6-9a1d-3184b56618c2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:50.053520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1202/2420] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:41:50.058815 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893e96-c899-489c-8698-049bf0f46cf1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:50.083393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893e96-c899-489c-8698-049bf0f46cf1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:50.088994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8650288-35fc-41f1-99da-f2675791fe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:50.089695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8650288-35fc-41f1-99da-f2675791fe04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.090000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8650288-35fc-41f1-99da-f2675791fe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.090289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8650288-35fc-41f1-99da-f2675791fe04 admin admin] PATH_INFO: `/v3/projects/7994112adc324067ae86d46f0e4ff4be/users/3369b8a03ba6413e8bd19e910e249b8f/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.117120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8650288-35fc-41f1-99da-f2675791fe04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7994112adc324067ae86d46f0e4ff4be, user_id=3369b8a03ba6413e8bd19e910e249b8f, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:50.120140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8650288-35fc-41f1-99da-f2675791fe04 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:50.147298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1219/2421] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:41:50 2022] PUT /identity/v3/projects/7994112adc324067ae86d46f0e4ff4be/users/3369b8a03ba6413e8bd19e910e249b8f/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:50.164468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c46b-1f20-4669-b16a-0ddf628db39a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.164740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c46b-1f20-4669-b16a-0ddf628db39a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.165014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c46b-1f20-4669-b16a-0ddf628db39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.210689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9df0c46b-1f20-4669-b16a-0ddf628db39a None None] MFA Rules not processed for user `3369b8a03ba6413e8bd19e910e249b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:50.212008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9df0c46b-1f20-4669-b16a-0ddf628db39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:50.304527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1203/2422] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:50.312730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8650288-35fc-41f1-99da-f2675791fe04 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:50.406638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8650288-35fc-41f1-99da-f2675791fe04 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:50.416275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2079e-a57c-485b-a419-da54a389b00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:50.417249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2079e-a57c-485b-a419-da54a389b00c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.417729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2079e-a57c-485b-a419-da54a389b00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.418161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2079e-a57c-485b-a419-da54a389b00c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.419093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2079e-a57c-485b-a419-da54a389b00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:50.422042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2079e-a57c-485b-a419-da54a389b00c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:50.469343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1220/2423] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:41:50 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:41:50.475206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0c46b-1f20-4669-b16a-0ddf628db39a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:50.498977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0c46b-1f20-4669-b16a-0ddf628db39a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:50.516277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:50.585096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ae90-eafb-4dbc-982b-2a2f9ac5607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:50.586203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ae90-eafb-4dbc-982b-2a2f9ac5607d admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.586741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ae90-eafb-4dbc-982b-2a2f9ac5607d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.587208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ae90-eafb-4dbc-982b-2a2f9ac5607d admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.588340 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216ae90-eafb-4dbc-982b-2a2f9ac5607d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:50.592228 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216ae90-eafb-4dbc-982b-2a2f9ac5607d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:50.632011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1204/2424] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:41:50 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:41:50.637122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2079e-a57c-485b-a419-da54a389b00c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:50.657128 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2079e-a57c-485b-a419-da54a389b00c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:50.665511 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493a71-f711-4c96-adcb-ecfc989f0d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:50.666560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493a71-f711-4c96-adcb-ecfc989f0d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.667123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493a71-f711-4c96-adcb-ecfc989f0d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.667663 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493a71-f711-4c96-adcb-ecfc989f0d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.668839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493a71-f711-4c96-adcb-ecfc989f0d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:50.672073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493a71-f711-4c96-adcb-ecfc989f0d97 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:50.701474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1221/2425] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:41:50.702604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ae90-eafb-4dbc-982b-2a2f9ac5607d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:50.717532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ae90-eafb-4dbc-982b-2a2f9ac5607d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:50.724230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd643e6-38ff-4e3d-8130-fbc6ccd1a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:50.724931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd643e6-38ff-4e3d-8130-fbc6ccd1a395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.725404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd643e6-38ff-4e3d-8130-fbc6ccd1a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.725626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd643e6-38ff-4e3d-8130-fbc6ccd1a395 admin admin] PATH_INFO: `/v3/projects/667be4b50b084a75a9c8eaf4aa3b61f8/users/79d0303c857f48a2847058b86c8dfa97/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.752080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd643e6-38ff-4e3d-8130-fbc6ccd1a395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667be4b50b084a75a9c8eaf4aa3b61f8, user_id=79d0303c857f48a2847058b86c8dfa97, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:50.755128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd643e6-38ff-4e3d-8130-fbc6ccd1a395 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:50.778059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1205/2426] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:41:50 2022] PUT /identity/v3/projects/667be4b50b084a75a9c8eaf4aa3b61f8/users/79d0303c857f48a2847058b86c8dfa97/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:41:50.779220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493a71-f711-4c96-adcb-ecfc989f0d97 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:50.786030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:50.796733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493a71-f711-4c96-adcb-ecfc989f0d97 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:50.901793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2705-12c0-40fd-9e94-56c43797380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:50.902533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2705-12c0-40fd-9e94-56c43797380e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.903008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2705-12c0-40fd-9e94-56c43797380e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.903293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2705-12c0-40fd-9e94-56c43797380e admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.904402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae2705-12c0-40fd-9e94-56c43797380e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:50.906871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae2705-12c0-40fd-9e94-56c43797380e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:50.934804 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1222/2427] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:41:50.939411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd643e6-38ff-4e3d-8130-fbc6ccd1a395 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:50.958451 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd643e6-38ff-4e3d-8130-fbc6ccd1a395 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:50.965553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1016e-788f-4c81-8a72-04f3a6d878c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:50.966967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1016e-788f-4c81-8a72-04f3a6d878c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.967521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1016e-788f-4c81-8a72-04f3a6d878c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.968095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1016e-788f-4c81-8a72-04f3a6d878c8 admin admin] PATH_INFO: `/v3/projects/667be4b50b084a75a9c8eaf4aa3b61f8/users/79d0303c857f48a2847058b86c8dfa97/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.971838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1016e-788f-4c81-8a72-04f3a6d878c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667be4b50b084a75a9c8eaf4aa3b61f8, user_id=79d0303c857f48a2847058b86c8dfa97, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:50.977367 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1016e-788f-4c81-8a72-04f3a6d878c8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:51.006533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1206/2428] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:41:50 2022] PUT /identity/v3/projects/667be4b50b084a75a9c8eaf4aa3b61f8/users/79d0303c857f48a2847058b86c8dfa97/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:51.072754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c575c2f-7fe7-4763-b1ad-54b5c648ece2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:51.073611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c575c2f-7fe7-4763-b1ad-54b5c648ece2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:51.073611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c575c2f-7fe7-4763-b1ad-54b5c648ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:51.109823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7c575c2f-7fe7-4763-b1ad-54b5c648ece2 None None] MFA Rules not processed for user `79d0303c857f48a2847058b86c8dfa97`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:51.112116 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7c575c2f-7fe7-4763-b1ad-54b5c648ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:51.232055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1223/2429] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:51.244769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1016e-788f-4c81-8a72-04f3a6d878c8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:51.246727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cbc1016e-788f-4c81-8a72-04f3a6d878c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:51.325162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1016e-788f-4c81-8a72-04f3a6d878c8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:51.332195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1c9e-8498-42d8-965f-69dbc2b958ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:51.333641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1c9e-8498-42d8-965f-69dbc2b958ce service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:51.333829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1c9e-8498-42d8-965f-69dbc2b958ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:51.334429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1c9e-8498-42d8-965f-69dbc2b958ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:51.416937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1c9e-8498-42d8-965f-69dbc2b958ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:51.418530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1c9e-8498-42d8-965f-69dbc2b958ce service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:51.431632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1207/2430] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:52.981636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c575c2f-7fe7-4763-b1ad-54b5c648ece2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:52.999062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c575c2f-7fe7-4763-b1ad-54b5c648ece2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:53.003915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee956c83-e907-4343-acc5-6b9f64b0549d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:53.004698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee956c83-e907-4343-acc5-6b9f64b0549d service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:53.005089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee956c83-e907-4343-acc5-6b9f64b0549d service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:53.005494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee956c83-e907-4343-acc5-6b9f64b0549d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:53.018840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee956c83-e907-4343-acc5-6b9f64b0549d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:53.020865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee956c83-e907-4343-acc5-6b9f64b0549d service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:53.032163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1224/2431] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:53.646436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e5a8c-80f1-4549-b07a-db16a5b68226 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:53.647196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e5a8c-80f1-4549-b07a-db16a5b68226 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:53.647196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e5a8c-80f1-4549-b07a-db16a5b68226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:53.675224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e38e5a8c-80f1-4549-b07a-db16a5b68226 None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:53.676476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e38e5a8c-80f1-4549-b07a-db16a5b68226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:53.696702 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:53.743754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1208/2432] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:41:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:53.757589 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee956c83-e907-4343-acc5-6b9f64b0549d service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:53.759222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ee956c83-e907-4343-acc5-6b9f64b0549d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:53.850315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee956c83-e907-4343-acc5-6b9f64b0549d service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:53.856968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00928f30-ec11-4f6d-82b8-dd8584fb1c69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:53.857835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00928f30-ec11-4f6d-82b8-dd8584fb1c69 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:53.858109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00928f30-ec11-4f6d-82b8-dd8584fb1c69 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:53.858367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00928f30-ec11-4f6d-82b8-dd8584fb1c69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:53.868650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00928f30-ec11-4f6d-82b8-dd8584fb1c69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:53.870613 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00928f30-ec11-4f6d-82b8-dd8584fb1c69 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:53.876434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:53.882198 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1225/2433] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:41:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:54.038273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e5a8c-80f1-4549-b07a-db16a5b68226 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:54.040307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e38e5a8c-80f1-4549-b07a-db16a5b68226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:54.125051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e5a8c-80f1-4549-b07a-db16a5b68226 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:54.129403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e1eb1-1bb1-46d8-8075-13998da78492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:54.130051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e1eb1-1bb1-46d8-8075-13998da78492 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:54.130322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e1eb1-1bb1-46d8-8075-13998da78492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:54.130596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e1eb1-1bb1-46d8-8075-13998da78492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:54.132619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c02e1eb1-1bb1-46d8-8075-13998da78492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:54.293584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e1eb1-1bb1-46d8-8075-13998da78492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:54.295387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e1eb1-1bb1-46d8-8075-13998da78492 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:54.317663 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1209/2434] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:41:57.634042 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00928f30-ec11-4f6d-82b8-dd8584fb1c69 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:57.669389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00928f30-ec11-4f6d-82b8-dd8584fb1c69 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:57.680981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:57.683455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:57.685001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:57.685456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] PATH_INFO: `/v3/users/3369b8a03ba6413e8bd19e910e249b8f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:57.690061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3369b8a03ba6413e8bd19e910e249b8f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:57.694748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:57.822575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3369b8a03ba6413e8bd19e910e249b8f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:57.828887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3369b8a03ba6413e8bd19e910e249b8f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:57.885797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3369b8a03ba6413e8bd19e910e249b8f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:57.919702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3369b8a03ba6413e8bd19e910e249b8f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:57.935163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3369b8a03ba6413e8bd19e910e249b8f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:57.955388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1226/2435] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:57 2022] DELETE /identity/v3/users/3369b8a03ba6413e8bd19e910e249b8f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:57.961566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cf4df-c156-4019-a70e-a1e3898e130b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:57.962276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cf4df-c156-4019-a70e-a1e3898e130b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:57.962276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cf4df-c156-4019-a70e-a1e3898e130b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:58.000022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-609cf4df-c156-4019-a70e-a1e3898e130b None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:58.003000 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-609cf4df-c156-4019-a70e-a1e3898e130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:58.124149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1210/2436] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:58.124686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:58.126834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:58.278530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144dd85-066c-4648-9bef-0e87476a052c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:58.283882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af11685-1e04-4339-8bca-4453baf1497f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:58.285821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af11685-1e04-4339-8bca-4453baf1497f service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:58.286281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af11685-1e04-4339-8bca-4453baf1497f service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:58.286759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af11685-1e04-4339-8bca-4453baf1497f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:58.329278 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af11685-1e04-4339-8bca-4453baf1497f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:58.332243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af11685-1e04-4339-8bca-4453baf1497f service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:58.358776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1227/2437] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:41:59.133632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cf4df-c156-4019-a70e-a1e3898e130b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:59.136854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-609cf4df-c156-4019-a70e-a1e3898e130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:59.187263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cf4df-c156-4019-a70e-a1e3898e130b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:59.216505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:59.217695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:59.218183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:59.218700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] PATH_INFO: `/v3/projects/7994112adc324067ae86d46f0e4ff4be` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:59.230128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7994112adc324067ae86d46f0e4ff4be)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:59.246313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:59.283734 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:59.371530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7994112adc324067ae86d46f0e4ff4be', 'request_id': 'req-321de6f7-fda9-4a83-9464-0bcb30b1357b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:59.412019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7994112adc324067ae86d46f0e4ff4be', 'request_id': 'req-321de6f7-fda9-4a83-9464-0bcb30b1357b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:59.421387 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7994112adc324067ae86d46f0e4ff4be', 'request_id': 'req-321de6f7-fda9-4a83-9464-0bcb30b1357b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:59.457414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] The token cache is being invalidate because project 7994112adc324067ae86d46f0e4ff4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:41:59.457712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:59.458859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:59.460993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1211/2438] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:41:59 2022] DELETE /identity/v3/projects/7994112adc324067ae86d46f0e4ff4be => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:41:59.467757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af11685-1e04-4339-8bca-4453baf1497f service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:59.541659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af11685-1e04-4339-8bca-4453baf1497f service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:59.773441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:59.774126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:59.774477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:59.774913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] PATH_INFO: `/v3/users/79d0303c857f48a2847058b86c8dfa97` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:59.780020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d0303c857f48a2847058b86c8dfa97)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:59.782302 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:59.812867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:59.918983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d0303c857f48a2847058b86c8dfa97'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:59.920377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d0303c857f48a2847058b86c8dfa97'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:41:59.983713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d0303c857f48a2847058b86c8dfa97'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:00.015876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d0303c857f48a2847058b86c8dfa97'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:00.048109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d0303c857f48a2847058b86c8dfa97'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:00.062357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1228/2439] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:41:59 2022] DELETE /identity/v3/users/79d0303c857f48a2847058b86c8dfa97 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:00.150789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:00.153080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:00.182582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321de6f7-fda9-4a83-9464-0bcb30b1357b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:00.327271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:00.328866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:00.329623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:00.330378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] PATH_INFO: `/v3/users/1507cffe84dc4849a7040333ad48d99c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:00.333101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1507cffe84dc4849a7040333ad48d99c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:00.337326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:00.443384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1507cffe84dc4849a7040333ad48d99c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:00.444273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1507cffe84dc4849a7040333ad48d99c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:00.445125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1507cffe84dc4849a7040333ad48d99c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:00.466061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1507cffe84dc4849a7040333ad48d99c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:00.484562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1507cffe84dc4849a7040333ad48d99c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:00.514080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1212/2440] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:00 2022] DELETE /identity/v3/users/1507cffe84dc4849a7040333ad48d99c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:00.720252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:00.723169 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:00.775040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a36e2-d5c8-4038-9620-4c3b38cda99c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:01.037664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:01.039523 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:01.063944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:01.064950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.065412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.066631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] PATH_INFO: `/v3/projects/667be4b50b084a75a9c8eaf4aa3b61f8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.068256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=667be4b50b084a75a9c8eaf4aa3b61f8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:01.072962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:01.113945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:01.173216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667be4b50b084a75a9c8eaf4aa3b61f8', 'request_id': 'req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.186389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667be4b50b084a75a9c8eaf4aa3b61f8', 'request_id': 'req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.197077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667be4b50b084a75a9c8eaf4aa3b61f8', 'request_id': 'req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.217399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] The token cache is being invalidate because project 667be4b50b084a75a9c8eaf4aa3b61f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:01.217728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.218358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c3488a70-55c8-46e5-8eab-73ab83cf3e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.219922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1229/2441] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:00 2022] DELETE /identity/v3/projects/667be4b50b084a75a9c8eaf4aa3b61f8 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:01.225830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c173a7-e346-433e-8880-3a9cad1ab633 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.226146 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ec0f-333a-4d32-941f-7cb4100b7a3c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:01.227007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c173a7-e346-433e-8880-3a9cad1ab633 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.227007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c173a7-e346-433e-8880-3a9cad1ab633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.261913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-80c173a7-e346-433e-8880-3a9cad1ab633 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:01.263966 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-80c173a7-e346-433e-8880-3a9cad1ab633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:01.310941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:01.359701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:01.360938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.362674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.362674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] PATH_INFO: `/v3/projects/8a745b184d3a462fae7c81ce668b01d2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.364610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a745b184d3a462fae7c81ce668b01d2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:01.368940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:01.389642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1230/2442] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:01.399063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ad0f9-308d-4107-82c3-0e8fba261e17 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.399358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ad0f9-308d-4107-82c3-0e8fba261e17 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.399633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ad0f9-308d-4107-82c3-0e8fba261e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.428026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-666ad0f9-308d-4107-82c3-0e8fba261e17 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:01.429674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-666ad0f9-308d-4107-82c3-0e8fba261e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:01.452580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a745b184d3a462fae7c81ce668b01d2', 'request_id': 'req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.463355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a745b184d3a462fae7c81ce668b01d2', 'request_id': 'req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.475040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a745b184d3a462fae7c81ce668b01d2', 'request_id': 'req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.493428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] The token cache is being invalidate because project 8a745b184d3a462fae7c81ce668b01d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:01.493903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.494504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a82b506-0ac2-4f6a-b9ef-aa83a9b2dac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:01.505587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1213/2443] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:01 2022] DELETE /identity/v3/projects/8a745b184d3a462fae7c81ce668b01d2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:01.508502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790942a6-49e3-41e9-a8a0-4f44e7b6884a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.508983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790942a6-49e3-41e9-a8a0-4f44e7b6884a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.509444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790942a6-49e3-41e9-a8a0-4f44e7b6884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.545167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-790942a6-49e3-41e9-a8a0-4f44e7b6884a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:01.546750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-790942a6-49e3-41e9-a8a0-4f44e7b6884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:01.598277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1231/2444] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:01.599351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ad0f9-308d-4107-82c3-0e8fba261e17 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:01.623353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ad0f9-308d-4107-82c3-0e8fba261e17 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:01.633645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bce3c8-9f6b-4c5c-a0e6-0e5ece2f690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:01.634542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bce3c8-9f6b-4c5c-a0e6-0e5ece2f690e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.635105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bce3c8-9f6b-4c5c-a0e6-0e5ece2f690e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.635340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bce3c8-9f6b-4c5c-a0e6-0e5ece2f690e admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.636218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bce3c8-9f6b-4c5c-a0e6-0e5ece2f690e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:42:01.637199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bce3c8-9f6b-4c5c-a0e6-0e5ece2f690e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:01.637948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:01.640130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bce3c8-9f6b-4c5c-a0e6-0e5ece2f690e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:01.663133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1214/2445] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:01.669179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1232/2446] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:42:01.671031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790942a6-49e3-41e9-a8a0-4f44e7b6884a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:01.676522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f61435-b7f9-4ea2-a242-b26a4475c2da None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.677163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f61435-b7f9-4ea2-a242-b26a4475c2da None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.677855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f61435-b7f9-4ea2-a242-b26a4475c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.693037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790942a6-49e3-41e9-a8a0-4f44e7b6884a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:01.702248 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff43e8-a3d6-48c9-90fe-fbbe854dec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:01.703462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff43e8-a3d6-48c9-90fe-fbbe854dec6b admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.703916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff43e8-a3d6-48c9-90fe-fbbe854dec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.704342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff43e8-a3d6-48c9-90fe-fbbe854dec6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.705635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff43e8-a3d6-48c9-90fe-fbbe854dec6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:01.708080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff43e8-a3d6-48c9-90fe-fbbe854dec6b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:01.711071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-02f61435-b7f9-4ea2-a242-b26a4475c2da None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:01.713645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-02f61435-b7f9-4ea2-a242-b26a4475c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:01.729428 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1233/2447] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:01.739388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f61435-b7f9-4ea2-a242-b26a4475c2da None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:01.764475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f61435-b7f9-4ea2-a242-b26a4475c2da None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:01.767268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1215/2448] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:01 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:01.772938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff43e8-a3d6-48c9-90fe-fbbe854dec6b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:01.890959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042610-732f-4c4e-958c-a5f52955a1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:01.891447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042610-732f-4c4e-958c-a5f52955a1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.891749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042610-732f-4c4e-958c-a5f52955a1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.892008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042610-732f-4c4e-958c-a5f52955a1fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.892909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042610-732f-4c4e-958c-a5f52955a1fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:42:01.893239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042610-732f-4c4e-958c-a5f52955a1fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:01.894979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042610-732f-4c4e-958c-a5f52955a1fc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:01.900580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff43e8-a3d6-48c9-90fe-fbbe854dec6b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:01.909569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7dc39-43ec-4ec4-96ea-fee6fb5d9599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:01.911255 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7dc39-43ec-4ec4-96ea-fee6fb5d9599 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.912123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7dc39-43ec-4ec4-96ea-fee6fb5d9599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.912931 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7dc39-43ec-4ec4-96ea-fee6fb5d9599 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.919731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1234/2449] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:42:01.920753 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7dc39-43ec-4ec4-96ea-fee6fb5d9599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:01.920989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042610-732f-4c4e-958c-a5f52955a1fc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:01.925033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7dc39-43ec-4ec4-96ea-fee6fb5d9599 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:01.933002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042610-732f-4c4e-958c-a5f52955a1fc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:01.938539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed4049-69c3-4190-aa02-47fe2d39e3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:01.939457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed4049-69c3-4190-aa02-47fe2d39e3cd admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.939806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed4049-69c3-4190-aa02-47fe2d39e3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.940333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed4049-69c3-4190-aa02-47fe2d39e3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.941047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed4049-69c3-4190-aa02-47fe2d39e3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:01.943376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed4049-69c3-4190-aa02-47fe2d39e3cd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:01.972538 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1216/2450] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:01 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:01.981637 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7dc39-43ec-4ec4-96ea-fee6fb5d9599 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:01.993280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1235/2451] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:01 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:02.000050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed4049-69c3-4190-aa02-47fe2d39e3cd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.005325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7dc39-43ec-4ec4-96ea-fee6fb5d9599 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.062953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:02.145391 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed4049-69c3-4190-aa02-47fe2d39e3cd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.159301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04233b4-4165-4edf-a269-50b8efdb7d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.160706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04233b4-4165-4edf-a269-50b8efdb7d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.162197 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9ff45-0844-44a2-9f30-8b628789af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.162570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04233b4-4165-4edf-a269-50b8efdb7d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.163266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04233b4-4165-4edf-a269-50b8efdb7d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.163521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9ff45-0844-44a2-9f30-8b628789af03 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.163973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9ff45-0844-44a2-9f30-8b628789af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.164416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9ff45-0844-44a2-9f30-8b628789af03 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.165245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04233b4-4165-4edf-a269-50b8efdb7d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.165465 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9ff45-0844-44a2-9f30-8b628789af03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.168775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04233b4-4165-4edf-a269-50b8efdb7d50 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:02.169154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9ff45-0844-44a2-9f30-8b628789af03 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:02.194736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1217/2452] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:02.200091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04233b4-4165-4edf-a269-50b8efdb7d50 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.217474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04233b4-4165-4edf-a269-50b8efdb7d50 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.227583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad9c4f-4b56-4f4b-aa2a-74a014084340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.228634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad9c4f-4b56-4f4b-aa2a-74a014084340 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.229008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad9c4f-4b56-4f4b-aa2a-74a014084340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.229483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad9c4f-4b56-4f4b-aa2a-74a014084340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.230740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad9c4f-4b56-4f4b-aa2a-74a014084340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.241743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad9c4f-4b56-4f4b-aa2a-74a014084340 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:02.251238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1236/2453] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:01 2022] POST /identity/v3/users => generated 283 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:02.257763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9ff45-0844-44a2-9f30-8b628789af03 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.277818 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1218/2454] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:02.279898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9ff45-0844-44a2-9f30-8b628789af03 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.285059 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad9c4f-4b56-4f4b-aa2a-74a014084340 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.291826 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704914-1136-4622-b047-5ad63ee7bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.293189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704914-1136-4622-b047-5ad63ee7bbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.293752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704914-1136-4622-b047-5ad63ee7bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.294312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704914-1136-4622-b047-5ad63ee7bbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.295670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c704914-1136-4622-b047-5ad63ee7bbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.299475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c704914-1136-4622-b047-5ad63ee7bbd1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:02.309701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad9c4f-4b56-4f4b-aa2a-74a014084340 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.319884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de0a51-db38-46e4-b6ba-55030f43811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.321441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de0a51-db38-46e4-b6ba-55030f43811b admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.321536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de0a51-db38-46e4-b6ba-55030f43811b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.321936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de0a51-db38-46e4-b6ba-55030f43811b admin admin] PATH_INFO: `/v3/projects/3e32e6f76b5247ce8f191f1aea018d78/users/a106f1bca69d445caf8f09bd19eb4fe1/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.322304 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1237/2455] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:02.333612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704914-1136-4622-b047-5ad63ee7bbd1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.353777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704914-1136-4622-b047-5ad63ee7bbd1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.359752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de0a51-db38-46e4-b6ba-55030f43811b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e32e6f76b5247ce8f191f1aea018d78, user_id=a106f1bca69d445caf8f09bd19eb4fe1, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.363260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d5830-e2b0-48a4-ad75-b1d2bf6111f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.370896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d5830-e2b0-48a4-ad75-b1d2bf6111f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.371109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de0a51-db38-46e4-b6ba-55030f43811b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:02.371348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d5830-e2b0-48a4-ad75-b1d2bf6111f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.371348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d5830-e2b0-48a4-ad75-b1d2bf6111f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.371348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d5830-e2b0-48a4-ad75-b1d2bf6111f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.371348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d5830-e2b0-48a4-ad75-b1d2bf6111f4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:02.390822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1238/2457] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:02.391016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1219/2457] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:02 2022] PUT /identity/v3/projects/3e32e6f76b5247ce8f191f1aea018d78/users/a106f1bca69d445caf8f09bd19eb4fe1/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:02.397314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d5830-e2b0-48a4-ad75-b1d2bf6111f4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.410960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd46be-e622-4d7d-ab2e-c5538d0e5147 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.411244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd46be-e622-4d7d-ab2e-c5538d0e5147 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.414724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd46be-e622-4d7d-ab2e-c5538d0e5147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.424272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d5830-e2b0-48a4-ad75-b1d2bf6111f4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.487147 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-37cd46be-e622-4d7d-ab2e-c5538d0e5147 None None] MFA Rules not processed for user `a106f1bca69d445caf8f09bd19eb4fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:02.489860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-37cd46be-e622-4d7d-ab2e-c5538d0e5147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:02.529444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:02.550597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadc4aa-b995-48f4-aab6-0de592feb6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.554510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadc4aa-b995-48f4-aab6-0de592feb6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.555336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadc4aa-b995-48f4-aab6-0de592feb6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.556439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadc4aa-b995-48f4-aab6-0de592feb6a7 admin admin] PATH_INFO: `/v3/projects/b49da485fcba435598ae2d5f8cc1ca43/users/e8196dac6cb14543b19e2a627bcf666b/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.586352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadc4aa-b995-48f4-aab6-0de592feb6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49da485fcba435598ae2d5f8cc1ca43, user_id=e8196dac6cb14543b19e2a627bcf666b, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.591357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadc4aa-b995-48f4-aab6-0de592feb6a7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:02.621501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1239/2458] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:02 2022] PUT /identity/v3/projects/b49da485fcba435598ae2d5f8cc1ca43/users/e8196dac6cb14543b19e2a627bcf666b/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:02.634443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeede11a-34aa-42fd-bafb-80a9319bbc24 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.634782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeede11a-34aa-42fd-bafb-80a9319bbc24 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.635168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeede11a-34aa-42fd-bafb-80a9319bbc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.642739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1220/2459] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:02.646125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd46be-e622-4d7d-ab2e-c5538d0e5147 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.662359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd46be-e622-4d7d-ab2e-c5538d0e5147 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.688780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-aeede11a-34aa-42fd-bafb-80a9319bbc24 None None] MFA Rules not processed for user `e8196dac6cb14543b19e2a627bcf666b`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:02.691713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-aeede11a-34aa-42fd-bafb-80a9319bbc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:02.782632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49f4dd-0fc7-4916-b73a-5a6c76697d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.783514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49f4dd-0fc7-4916-b73a-5a6c76697d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.784088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49f4dd-0fc7-4916-b73a-5a6c76697d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.784505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49f4dd-0fc7-4916-b73a-5a6c76697d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.785182 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49f4dd-0fc7-4916-b73a-5a6c76697d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.787359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49f4dd-0fc7-4916-b73a-5a6c76697d8e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:02.830700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1221/2460] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:02 2022] POST /identity/v3/projects => generated 401 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:42:02.836184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49f4dd-0fc7-4916-b73a-5a6c76697d8e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.847168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:02.866742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1240/2461] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:02.868992 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeede11a-34aa-42fd-bafb-80a9319bbc24 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.892218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeede11a-34aa-42fd-bafb-80a9319bbc24 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.955935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49f4dd-0fc7-4916-b73a-5a6c76697d8e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.961824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a6166-35c2-4b24-87a9-1e4b398e8a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.962682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a6166-35c2-4b24-87a9-1e4b398e8a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.963065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a6166-35c2-4b24-87a9-1e4b398e8a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.963444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a6166-35c2-4b24-87a9-1e4b398e8a71 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.964222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a6166-35c2-4b24-87a9-1e4b398e8a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.967012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a6166-35c2-4b24-87a9-1e4b398e8a71 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.008177 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1222/2462] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:02 2022] POST /identity/v3/users => generated 307 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:03.012276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a6166-35c2-4b24-87a9-1e4b398e8a71 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.037388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a6166-35c2-4b24-87a9-1e4b398e8a71 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:03.045624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c5d6-e629-4252-8035-01c6a7242c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.045624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c5d6-e629-4252-8035-01c6a7242c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.045624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c5d6-e629-4252-8035-01c6a7242c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.045624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c5d6-e629-4252-8035-01c6a7242c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.046642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c5d6-e629-4252-8035-01c6a7242c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.048301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c5d6-e629-4252-8035-01c6a7242c92 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.054309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e760-378c-442e-8c17-f126a3b194df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.055384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e760-378c-442e-8c17-f126a3b194df admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.056659 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e760-378c-442e-8c17-f126a3b194df admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.057153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e760-378c-442e-8c17-f126a3b194df admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.058377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e760-378c-442e-8c17-f126a3b194df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.062100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e760-378c-442e-8c17-f126a3b194df admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.083618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1223/2463] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:03.090606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e760-378c-442e-8c17-f126a3b194df admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.099679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1241/2464] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:02 2022] POST /identity/v3/projects => generated 365 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:42:03.106129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c5d6-e629-4252-8035-01c6a7242c92 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.108039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e760-378c-442e-8c17-f126a3b194df admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:03.137388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:03.213672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c5d6-e629-4252-8035-01c6a7242c92 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:03.220355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47435e2c-d783-4921-a9c7-67c4f49b04b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.221097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47435e2c-d783-4921-a9c7-67c4f49b04b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.221404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47435e2c-d783-4921-a9c7-67c4f49b04b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.221678 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47435e2c-d783-4921-a9c7-67c4f49b04b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.222333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47435e2c-d783-4921-a9c7-67c4f49b04b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.223570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7361aa-59d8-47e1-9fa7-843c4505c693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.224583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7361aa-59d8-47e1-9fa7-843c4505c693 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.224872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47435e2c-d783-4921-a9c7-67c4f49b04b2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.225551 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7361aa-59d8-47e1-9fa7-843c4505c693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.226031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7361aa-59d8-47e1-9fa7-843c4505c693 admin admin] PATH_INFO: `/v3/projects/4cfaae93124b440ab469b1197ff3eb3f/users/e2b67c94400e4fe2b9961a5275b614de/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.248126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7361aa-59d8-47e1-9fa7-843c4505c693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfaae93124b440ab469b1197ff3eb3f, user_id=e2b67c94400e4fe2b9961a5275b614de, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.252684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7361aa-59d8-47e1-9fa7-843c4505c693 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.270248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1242/2465] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:03 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:03.271549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47435e2c-d783-4921-a9c7-67c4f49b04b2 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.280352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1224/2466] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:03 2022] PUT /identity/v3/projects/4cfaae93124b440ab469b1197ff3eb3f/users/e2b67c94400e4fe2b9961a5275b614de/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:03.282487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7361aa-59d8-47e1-9fa7-843c4505c693 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.292228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47435e2c-d783-4921-a9c7-67c4f49b04b2 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:03.420862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f567-b202-408c-96e3-4d8a7f6a656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.420862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f567-b202-408c-96e3-4d8a7f6a656a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.420862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f567-b202-408c-96e3-4d8a7f6a656a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.420862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f567-b202-408c-96e3-4d8a7f6a656a admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.421335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949f567-b202-408c-96e3-4d8a7f6a656a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.422267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949f567-b202-408c-96e3-4d8a7f6a656a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.446623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7361aa-59d8-47e1-9fa7-843c4505c693 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:03.450311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1243/2467] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:03.457067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f567-b202-408c-96e3-4d8a7f6a656a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.471485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750549-5a97-40d2-bbcc-fd011526a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.472142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750549-5a97-40d2-bbcc-fd011526a72a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.472447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750549-5a97-40d2-bbcc-fd011526a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.472722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750549-5a97-40d2-bbcc-fd011526a72a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.473393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750549-5a97-40d2-bbcc-fd011526a72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.475296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750549-5a97-40d2-bbcc-fd011526a72a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.479957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f567-b202-408c-96e3-4d8a7f6a656a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:03.488549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1225/2468] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:03.493487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750549-5a97-40d2-bbcc-fd011526a72a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.493727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab227564-39c7-4dab-b55b-173775ccdad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.494857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab227564-39c7-4dab-b55b-173775ccdad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.495550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab227564-39c7-4dab-b55b-173775ccdad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.496067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab227564-39c7-4dab-b55b-173775ccdad6 admin admin] PATH_INFO: `/v3/projects/a79349179b874e77b4a26cddb4cb61cb/users/ec2db1609b51405da7e8ca05e6d895a6/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.503092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:03.520364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750549-5a97-40d2-bbcc-fd011526a72a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:03.536626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eec9c-2724-41d3-9496-0dec67f93b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.537520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eec9c-2724-41d3-9496-0dec67f93b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.537906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eec9c-2724-41d3-9496-0dec67f93b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.538240 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eec9c-2724-41d3-9496-0dec67f93b4b admin admin] PATH_INFO: `/v3/projects/4cfaae93124b440ab469b1197ff3eb3f/users/e2b67c94400e4fe2b9961a5275b614de/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.541222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eec9c-2724-41d3-9496-0dec67f93b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfaae93124b440ab469b1197ff3eb3f, user_id=e2b67c94400e4fe2b9961a5275b614de, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.544676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eec9c-2724-41d3-9496-0dec67f93b4b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.574699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1226/2469] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:03 2022] PUT /identity/v3/projects/4cfaae93124b440ab469b1197ff3eb3f/users/e2b67c94400e4fe2b9961a5275b614de/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:03.575017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab227564-39c7-4dab-b55b-173775ccdad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79349179b874e77b4a26cddb4cb61cb, user_id=ec2db1609b51405da7e8ca05e6d895a6, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.575017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab227564-39c7-4dab-b55b-173775ccdad6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.585034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e129adb-19de-43e8-bbeb-ed47b65f6c84 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.585571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e129adb-19de-43e8-bbeb-ed47b65f6c84 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.586158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e129adb-19de-43e8-bbeb-ed47b65f6c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.600301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1244/2470] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:03 2022] PUT /identity/v3/projects/a79349179b874e77b4a26cddb4cb61cb/users/ec2db1609b51405da7e8ca05e6d895a6/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:03.608437 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab227564-39c7-4dab-b55b-173775ccdad6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.681353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3e129adb-19de-43e8-bbeb-ed47b65f6c84 None None] MFA Rules not processed for user `e2b67c94400e4fe2b9961a5275b614de`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:03.683795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e129adb-19de-43e8-bbeb-ed47b65f6c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:03.765250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab227564-39c7-4dab-b55b-173775ccdad6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:03.778897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94ef3-0cb2-4861-8a56-d827ea0c0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.782629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94ef3-0cb2-4861-8a56-d827ea0c0702 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.783570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94ef3-0cb2-4861-8a56-d827ea0c0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.784268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94ef3-0cb2-4861-8a56-d827ea0c0702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.786219 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94ef3-0cb2-4861-8a56-d827ea0c0702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.791489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94ef3-0cb2-4861-8a56-d827ea0c0702 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.816735 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1245/2471] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:03.821813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94ef3-0cb2-4861-8a56-d827ea0c0702 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.828667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1227/2472] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:03 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:03.845206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94ef3-0cb2-4861-8a56-d827ea0c0702 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:03.853317 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dd12f-2228-4f6d-b93a-cef8ccd5b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:03.854374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e129adb-19de-43e8-bbeb-ed47b65f6c84 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:03.854557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dd12f-2228-4f6d-b93a-cef8ccd5b181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.854906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dd12f-2228-4f6d-b93a-cef8ccd5b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.855394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dd12f-2228-4f6d-b93a-cef8ccd5b181 admin admin] PATH_INFO: `/v3/projects/a79349179b874e77b4a26cddb4cb61cb/users/ec2db1609b51405da7e8ca05e6d895a6/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.856665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e129adb-19de-43e8-bbeb-ed47b65f6c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:03.858345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dd12f-2228-4f6d-b93a-cef8ccd5b181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79349179b874e77b4a26cddb4cb61cb, user_id=ec2db1609b51405da7e8ca05e6d895a6, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:03.862862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dd12f-2228-4f6d-b93a-cef8ccd5b181 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:03.884729 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1246/2473] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:03 2022] PUT /identity/v3/projects/a79349179b874e77b4a26cddb4cb61cb/users/ec2db1609b51405da7e8ca05e6d895a6/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:03.886326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89edb57-a74f-4f15-b66e-ed38a9ecc7cd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:03.886634 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89edb57-a74f-4f15-b66e-ed38a9ecc7cd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:03.886932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89edb57-a74f-4f15-b66e-ed38a9ecc7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:03.894965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:03.935274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e89edb57-a74f-4f15-b66e-ed38a9ecc7cd None None] MFA Rules not processed for user `ec2db1609b51405da7e8ca05e6d895a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:03.938937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e89edb57-a74f-4f15-b66e-ed38a9ecc7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:03.980552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e129adb-19de-43e8-bbeb-ed47b65f6c84 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:04.077460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a67c6b-90d7-4f3f-8ac6-047d9d6ae102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:04.078412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a67c6b-90d7-4f3f-8ac6-047d9d6ae102 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:04.079049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a67c6b-90d7-4f3f-8ac6-047d9d6ae102 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:04.079511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a67c6b-90d7-4f3f-8ac6-047d9d6ae102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:04.101637 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1247/2474] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:04.121133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89edb57-a74f-4f15-b66e-ed38a9ecc7cd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:04.124312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e89edb57-a74f-4f15-b66e-ed38a9ecc7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:04.145582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89edb57-a74f-4f15-b66e-ed38a9ecc7cd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:04.158358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85509bfd-9e6c-4338-a7e7-a2268fd18a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:04.158358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85509bfd-9e6c-4338-a7e7-a2268fd18a61 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:04.158711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85509bfd-9e6c-4338-a7e7-a2268fd18a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:04.158864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85509bfd-9e6c-4338-a7e7-a2268fd18a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:04.172413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85509bfd-9e6c-4338-a7e7-a2268fd18a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:04.174123 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85509bfd-9e6c-4338-a7e7-a2268fd18a61 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:04.187851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1248/2475] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:42:04.259100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a67c6b-90d7-4f3f-8ac6-047d9d6ae102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:04.262365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a67c6b-90d7-4f3f-8ac6-047d9d6ae102 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:04.286327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1228/2476] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:03 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:04.417518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85509bfd-9e6c-4338-a7e7-a2268fd18a61 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:04.436306 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85509bfd-9e6c-4338-a7e7-a2268fd18a61 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:04.441375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcdd92-b90b-4428-8089-ebebe076ebc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:04.448865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcdd92-b90b-4428-8089-ebebe076ebc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:04.449227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcdd92-b90b-4428-8089-ebebe076ebc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:04.449447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcdd92-b90b-4428-8089-ebebe076ebc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:04.542351 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:04.578189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcdd92-b90b-4428-8089-ebebe076ebc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:04.581125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcdd92-b90b-4428-8089-ebebe076ebc2 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:04.602261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1249/2477] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:04 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:04.986463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a67c6b-90d7-4f3f-8ac6-047d9d6ae102 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:05.103664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a67c6b-90d7-4f3f-8ac6-047d9d6ae102 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:05.112407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:05.113292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:05.113723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:05.114140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] PATH_INFO: `/v3/users/e8196dac6cb14543b19e2a627bcf666b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:05.116241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8196dac6cb14543b19e2a627bcf666b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:05.118485 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:05.164478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:05.223765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8196dac6cb14543b19e2a627bcf666b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:05.225346 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8196dac6cb14543b19e2a627bcf666b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:05.225966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8196dac6cb14543b19e2a627bcf666b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:05.244274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8196dac6cb14543b19e2a627bcf666b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:05.253854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8196dac6cb14543b19e2a627bcf666b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:05.277714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1229/2478] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:04 2022] DELETE /identity/v3/users/e8196dac6cb14543b19e2a627bcf666b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:05.283827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35851156-b1df-4091-82c5-03c7ae77733a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:05.285034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35851156-b1df-4091-82c5-03c7ae77733a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:05.285504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35851156-b1df-4091-82c5-03c7ae77733a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:05.316411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-35851156-b1df-4091-82c5-03c7ae77733a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:05.317664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-35851156-b1df-4091-82c5-03c7ae77733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:05.428007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1250/2479] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:05.440652 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:05.443376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:05.525512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100df34-1ce6-4328-9731-45d1b5a527f8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:05.531795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948479f-0baa-4a25-8b5c-5a6a848fe3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:05.532540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948479f-0baa-4a25-8b5c-5a6a848fe3fc service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:05.532812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948479f-0baa-4a25-8b5c-5a6a848fe3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:05.533203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948479f-0baa-4a25-8b5c-5a6a848fe3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:05.544553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948479f-0baa-4a25-8b5c-5a6a848fe3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:05.546026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948479f-0baa-4a25-8b5c-5a6a848fe3fc service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:05.557307 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1230/2480] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:05.986998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35851156-b1df-4091-82c5-03c7ae77733a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:05.989680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-35851156-b1df-4091-82c5-03c7ae77733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:06.021491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35851156-b1df-4091-82c5-03c7ae77733a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:06.057069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:06.058178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:06.059224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:06.060244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] PATH_INFO: `/v3/projects/b49da485fcba435598ae2d5f8cc1ca43` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:06.062896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49da485fcba435598ae2d5f8cc1ca43)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:06.065556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:06.163533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49da485fcba435598ae2d5f8cc1ca43', 'request_id': 'req-23d78a39-fec1-4652-a18b-341e2f3e284d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.196298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49da485fcba435598ae2d5f8cc1ca43', 'request_id': 'req-23d78a39-fec1-4652-a18b-341e2f3e284d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.227533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49da485fcba435598ae2d5f8cc1ca43', 'request_id': 'req-23d78a39-fec1-4652-a18b-341e2f3e284d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.257498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] The token cache is being invalidate because project b49da485fcba435598ae2d5f8cc1ca43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:06.257969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.259257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.262209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1251/2481] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:05 2022] DELETE /identity/v3/projects/b49da485fcba435598ae2d5f8cc1ca43 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:06.273199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948479f-0baa-4a25-8b5c-5a6a848fe3fc service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:06.307012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948479f-0baa-4a25-8b5c-5a6a848fe3fc service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:06.486911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:06.489023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:06.489994 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:06.490794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] PATH_INFO: `/v3/users/ec2db1609b51405da7e8ca05e6d895a6` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:06.493483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2db1609b51405da7e8ca05e6d895a6)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:06.497442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:06.562623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:06.575435 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2db1609b51405da7e8ca05e6d895a6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.582202 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2db1609b51405da7e8ca05e6d895a6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.588900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2db1609b51405da7e8ca05e6d895a6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.637982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2db1609b51405da7e8ca05e6d895a6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.650531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-abfa52b3-ec1f-4af1-ab98-6f74f9915d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2db1609b51405da7e8ca05e6d895a6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:06.687743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1231/2482] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:06 2022] DELETE /identity/v3/users/ec2db1609b51405da7e8ca05e6d895a6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:07.136285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:07.139542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:07.178692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78a39-fec1-4652-a18b-341e2f3e284d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:07.266577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:07.267348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:07.267676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:07.268063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] PATH_INFO: `/v3/projects/a79349179b874e77b4a26cddb4cb61cb` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:07.269332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79349179b874e77b4a26cddb4cb61cb)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:07.271381 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:07.277239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:07.358703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79349179b874e77b4a26cddb4cb61cb', 'request_id': 'req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:07.370530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79349179b874e77b4a26cddb4cb61cb', 'request_id': 'req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:07.389976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79349179b874e77b4a26cddb4cb61cb', 'request_id': 'req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:07.414961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] The token cache is being invalidate because project a79349179b874e77b4a26cddb4cb61cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:07.415261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:07.416400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e71f0f6c-3bcc-433c-808a-aeb12e2d120d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:07.432022 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1252/2483] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:07 2022] DELETE /identity/v3/projects/a79349179b874e77b4a26cddb4cb61cb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:07.437416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126740d-3b2f-44e9-a961-4e74b346cd5f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:07.438095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126740d-3b2f-44e9-a961-4e74b346cd5f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:07.438095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126740d-3b2f-44e9-a961-4e74b346cd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:07.469021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a126740d-3b2f-44e9-a961-4e74b346cd5f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:07.469802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a126740d-3b2f-44e9-a961-4e74b346cd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:07.577360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1232/2484] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:07.589816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848ff4a-f472-4205-86c6-969f29c09510 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:07.590239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848ff4a-f472-4205-86c6-969f29c09510 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:07.590644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848ff4a-f472-4205-86c6-969f29c09510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:07.637568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0848ff4a-f472-4205-86c6-969f29c09510 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:07.639884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0848ff4a-f472-4205-86c6-969f29c09510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:07.653363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1253/2485] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:07.659591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126740d-3b2f-44e9-a961-4e74b346cd5f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:07.679178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126740d-3b2f-44e9-a961-4e74b346cd5f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:07.694209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2556-454c-40cf-98b0-fea2c0d408af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:07.695680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2556-454c-40cf-98b0-fea2c0d408af admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:07.696442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2556-454c-40cf-98b0-fea2c0d408af admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:07.697886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2556-454c-40cf-98b0-fea2c0d408af admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:07.699122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2556-454c-40cf-98b0-fea2c0d408af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:42:07.699881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2556-454c-40cf-98b0-fea2c0d408af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:07.702899 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2556-454c-40cf-98b0-fea2c0d408af admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:07.730884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1233/2486] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:42:07.733770 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848ff4a-f472-4205-86c6-969f29c09510 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:07.746558 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848ff4a-f472-4205-86c6-969f29c09510 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:07.755604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e37be-5ebe-4ce3-9dbc-8054468271d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:07.756683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e37be-5ebe-4ce3-9dbc-8054468271d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:07.757181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e37be-5ebe-4ce3-9dbc-8054468271d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:07.757674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e37be-5ebe-4ce3-9dbc-8054468271d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:07.758906 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e37be-5ebe-4ce3-9dbc-8054468271d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:07.762743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e37be-5ebe-4ce3-9dbc-8054468271d6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:07.819172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1254/2487] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:07 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:07.820108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2556-454c-40cf-98b0-fea2c0d408af admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:07.838428 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2556-454c-40cf-98b0-fea2c0d408af admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:07.939850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5b5e3-63f8-4649-91d0-7593a76b5f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:07.940997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5b5e3-63f8-4649-91d0-7593a76b5f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:07.941493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5b5e3-63f8-4649-91d0-7593a76b5f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:07.941981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5b5e3-63f8-4649-91d0-7593a76b5f9d admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:07.943193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5b5e3-63f8-4649-91d0-7593a76b5f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:07.946983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5b5e3-63f8-4649-91d0-7593a76b5f9d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:07.987658 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1234/2488] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:07 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:07.993871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e37be-5ebe-4ce3-9dbc-8054468271d6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:08.007301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e37be-5ebe-4ce3-9dbc-8054468271d6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:08.013578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff725d-cecf-4bef-a196-504a36b79106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:08.014222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff725d-cecf-4bef-a196-504a36b79106 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.014506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff725d-cecf-4bef-a196-504a36b79106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.014816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff725d-cecf-4bef-a196-504a36b79106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.015495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff725d-cecf-4bef-a196-504a36b79106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:08.017320 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff725d-cecf-4bef-a196-504a36b79106 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:08.030325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1255/2489] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:08.036496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5b5e3-63f8-4649-91d0-7593a76b5f9d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:08.056629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5b5e3-63f8-4649-91d0-7593a76b5f9d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:08.063379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863bc91-c7d9-4d62-bffb-dbca30e18829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:08.064074 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bc91-c7d9-4d62-bffb-dbca30e18829 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.064562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bc91-c7d9-4d62-bffb-dbca30e18829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.065003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bc91-c7d9-4d62-bffb-dbca30e18829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.065848 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863bc91-c7d9-4d62-bffb-dbca30e18829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:08.068101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863bc91-c7d9-4d62-bffb-dbca30e18829 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:08.082561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1235/2490] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:08.087795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff725d-cecf-4bef-a196-504a36b79106 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:08.102949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff725d-cecf-4bef-a196-504a36b79106 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:08.108696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ebe51-013f-4c64-a047-a8dcfb8a5e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:08.109445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ebe51-013f-4c64-a047-a8dcfb8a5e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.109737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ebe51-013f-4c64-a047-a8dcfb8a5e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.109991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ebe51-013f-4c64-a047-a8dcfb8a5e7d admin admin] PATH_INFO: `/v3/projects/5fe5763740034de28f939c4007e2785e/users/392897bfeb38487eab471734d90c2a9e/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.129902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ebe51-013f-4c64-a047-a8dcfb8a5e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe5763740034de28f939c4007e2785e, user_id=392897bfeb38487eab471734d90c2a9e, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:08.132947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ebe51-013f-4c64-a047-a8dcfb8a5e7d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:08.150133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1256/2491] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:08 2022] PUT /identity/v3/projects/5fe5763740034de28f939c4007e2785e/users/392897bfeb38487eab471734d90c2a9e/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:08.162242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4003ec7-b027-44bd-9877-a3c26015ca2c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.162857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4003ec7-b027-44bd-9877-a3c26015ca2c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.163375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4003ec7-b027-44bd-9877-a3c26015ca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.200579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a4003ec7-b027-44bd-9877-a3c26015ca2c None None] MFA Rules not processed for user `392897bfeb38487eab471734d90c2a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:08.201962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a4003ec7-b027-44bd-9877-a3c26015ca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:08.216868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:08.300082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1236/2492] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:08.305249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ebe51-013f-4c64-a047-a8dcfb8a5e7d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:08.380789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ebe51-013f-4c64-a047-a8dcfb8a5e7d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:08.385580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc4559-1cd4-49f2-b50e-d7eb02c9f9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:08.386199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc4559-1cd4-49f2-b50e-d7eb02c9f9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.386472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc4559-1cd4-49f2-b50e-d7eb02c9f9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.386774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc4559-1cd4-49f2-b50e-d7eb02c9f9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.387431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc4559-1cd4-49f2-b50e-d7eb02c9f9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:08.389370 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc4559-1cd4-49f2-b50e-d7eb02c9f9f1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:08.423730 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1257/2493] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:08 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:42:08.428467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4003ec7-b027-44bd-9877-a3c26015ca2c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:08.442045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4003ec7-b027-44bd-9877-a3c26015ca2c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:08.513938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb7d63-2a78-4e14-87e9-29e5510fe143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:08.514570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb7d63-2a78-4e14-87e9-29e5510fe143 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.514880 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb7d63-2a78-4e14-87e9-29e5510fe143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.515155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb7d63-2a78-4e14-87e9-29e5510fe143 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.515803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb7d63-2a78-4e14-87e9-29e5510fe143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:08.517990 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb7d63-2a78-4e14-87e9-29e5510fe143 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:08.543521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1237/2494] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:08 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:08.548824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc4559-1cd4-49f2-b50e-d7eb02c9f9f1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:08.560479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc4559-1cd4-49f2-b50e-d7eb02c9f9f1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:08.567722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad199-114d-4c8f-9c4c-26b57ae283cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:08.568368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad199-114d-4c8f-9c4c-26b57ae283cf admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.568641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad199-114d-4c8f-9c4c-26b57ae283cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.568938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad199-114d-4c8f-9c4c-26b57ae283cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.569599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad199-114d-4c8f-9c4c-26b57ae283cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:08.571309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad199-114d-4c8f-9c4c-26b57ae283cf admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:08.584265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1258/2495] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:08.592223 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb7d63-2a78-4e14-87e9-29e5510fe143 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:08.616862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb7d63-2a78-4e14-87e9-29e5510fe143 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:08.626278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a8d9b-2688-4cd8-a7bc-be1eaffc8549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:08.627414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a8d9b-2688-4cd8-a7bc-be1eaffc8549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.627900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a8d9b-2688-4cd8-a7bc-be1eaffc8549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.628393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a8d9b-2688-4cd8-a7bc-be1eaffc8549 admin admin] PATH_INFO: `/v3/projects/8b4fe92e66db4bad9a12db2d5a4e6460/users/9462b98fb8cd422d8673f4ae09ee7036/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.657109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a8d9b-2688-4cd8-a7bc-be1eaffc8549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4fe92e66db4bad9a12db2d5a4e6460, user_id=9462b98fb8cd422d8673f4ae09ee7036, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:08.663569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a8d9b-2688-4cd8-a7bc-be1eaffc8549 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:08.682930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1238/2496] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:08 2022] PUT /identity/v3/projects/8b4fe92e66db4bad9a12db2d5a4e6460/users/9462b98fb8cd422d8673f4ae09ee7036/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:08.687970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad199-114d-4c8f-9c4c-26b57ae283cf admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:08.694072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:08.702354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad199-114d-4c8f-9c4c-26b57ae283cf admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:08.803174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e511b70-eb04-43e6-981f-5e37d322b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:08.804500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e511b70-eb04-43e6-981f-5e37d322b46f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.804996 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e511b70-eb04-43e6-981f-5e37d322b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.805795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e511b70-eb04-43e6-981f-5e37d322b46f admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.807124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e511b70-eb04-43e6-981f-5e37d322b46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:08.810269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e511b70-eb04-43e6-981f-5e37d322b46f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:08.834720 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1259/2497] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:08.839615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a8d9b-2688-4cd8-a7bc-be1eaffc8549 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:08.861838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a8d9b-2688-4cd8-a7bc-be1eaffc8549 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:08.869794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fdb7e-86bd-4567-821a-a01dfa17f60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:08.871189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fdb7e-86bd-4567-821a-a01dfa17f60d admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.873113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fdb7e-86bd-4567-821a-a01dfa17f60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.873113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fdb7e-86bd-4567-821a-a01dfa17f60d admin admin] PATH_INFO: `/v3/projects/8b4fe92e66db4bad9a12db2d5a4e6460/users/9462b98fb8cd422d8673f4ae09ee7036/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.875888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fdb7e-86bd-4567-821a-a01dfa17f60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4fe92e66db4bad9a12db2d5a4e6460, user_id=9462b98fb8cd422d8673f4ae09ee7036, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:08.881887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fdb7e-86bd-4567-821a-a01dfa17f60d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:08.914700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1239/2498] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:08 2022] PUT /identity/v3/projects/8b4fe92e66db4bad9a12db2d5a4e6460/users/9462b98fb8cd422d8673f4ae09ee7036/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:08.920527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247866ef-9325-4cf9-a2fd-6a90aa637429 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:08.921014 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247866ef-9325-4cf9-a2fd-6a90aa637429 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:08.921506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247866ef-9325-4cf9-a2fd-6a90aa637429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:08.979519 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-247866ef-9325-4cf9-a2fd-6a90aa637429 None None] MFA Rules not processed for user `9462b98fb8cd422d8673f4ae09ee7036`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:08.981836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-247866ef-9325-4cf9-a2fd-6a90aa637429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:09.099880 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1260/2499] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:09.116391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fdb7e-86bd-4567-821a-a01dfa17f60d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:09.121918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d27fdb7e-86bd-4567-821a-a01dfa17f60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:09.212025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fdb7e-86bd-4567-821a-a01dfa17f60d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:09.216605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5377b-7be6-46e4-a540-4cf01cb2087e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:09.217227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5377b-7be6-46e4-a540-4cf01cb2087e service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:09.217505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5377b-7be6-46e4-a540-4cf01cb2087e service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:09.217773 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5377b-7be6-46e4-a540-4cf01cb2087e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:09.250613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:09.323832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5377b-7be6-46e4-a540-4cf01cb2087e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:09.325580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5377b-7be6-46e4-a540-4cf01cb2087e service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:09.337443 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1240/2500] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:09.455163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247866ef-9325-4cf9-a2fd-6a90aa637429 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:09.457401 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-247866ef-9325-4cf9-a2fd-6a90aa637429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:09.575052 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247866ef-9325-4cf9-a2fd-6a90aa637429 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:09.591289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:09.593048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:09.593529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:09.594765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] PATH_INFO: `/v3/users/a106f1bca69d445caf8f09bd19eb4fe1` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:09.598366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a106f1bca69d445caf8f09bd19eb4fe1)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:09.602175 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:09.667515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:09.703439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a106f1bca69d445caf8f09bd19eb4fe1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:09.705746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a106f1bca69d445caf8f09bd19eb4fe1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:09.747953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a106f1bca69d445caf8f09bd19eb4fe1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:09.763509 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a106f1bca69d445caf8f09bd19eb4fe1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:09.777864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a106f1bca69d445caf8f09bd19eb4fe1'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:09.795127 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1261/2501] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:09 2022] DELETE /identity/v3/users/a106f1bca69d445caf8f09bd19eb4fe1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:09.803575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adda9e-4830-463e-aa23-1ccfdd5f7534 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:09.803575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adda9e-4830-463e-aa23-1ccfdd5f7534 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:09.803575 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adda9e-4830-463e-aa23-1ccfdd5f7534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:09.832095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-28adda9e-4830-463e-aa23-1ccfdd5f7534 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:09.833378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-28adda9e-4830-463e-aa23-1ccfdd5f7534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:09.921168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1241/2502] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:09.934473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:09.936488 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:10.016280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67851867-93dc-42c8-95a0-1e999e7638c3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:10.021516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1d0e-5449-49f4-a068-5131cb081a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:10.023100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1d0e-5449-49f4-a068-5131cb081a2b service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:10.023100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1d0e-5449-49f4-a068-5131cb081a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:10.023497 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1d0e-5449-49f4-a068-5131cb081a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:10.037147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db1d0e-5449-49f4-a068-5131cb081a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:10.039528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db1d0e-5449-49f4-a068-5131cb081a2b service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:10.057967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1262/2503] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:10.538137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adda9e-4830-463e-aa23-1ccfdd5f7534 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:10.543799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-28adda9e-4830-463e-aa23-1ccfdd5f7534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:10.568951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adda9e-4830-463e-aa23-1ccfdd5f7534 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:10.581094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:10.581487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:10.582026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:10.582783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] PATH_INFO: `/v3/projects/3e32e6f76b5247ce8f191f1aea018d78` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:10.585339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e32e6f76b5247ce8f191f1aea018d78)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:10.589328 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:10.677918 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e32e6f76b5247ce8f191f1aea018d78', 'request_id': 'req-118c4c45-deae-4360-97e9-9dbe892ae41a'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:10.688237 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e32e6f76b5247ce8f191f1aea018d78', 'request_id': 'req-118c4c45-deae-4360-97e9-9dbe892ae41a'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:10.701889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e32e6f76b5247ce8f191f1aea018d78', 'request_id': 'req-118c4c45-deae-4360-97e9-9dbe892ae41a'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:10.722537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] The token cache is being invalidate because project 3e32e6f76b5247ce8f191f1aea018d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:10.722997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:10.723832 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:10.725680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1242/2504] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:10 2022] DELETE /identity/v3/projects/3e32e6f76b5247ce8f191f1aea018d78 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:10.730645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1d0e-5449-49f4-a068-5131cb081a2b service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:10.746439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1d0e-5449-49f4-a068-5131cb081a2b service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:10.860549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:10.862636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:10.863245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:10.863434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] PATH_INFO: `/v3/users/e2b67c94400e4fe2b9961a5275b614de` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:10.865224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b67c94400e4fe2b9961a5275b614de)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:10.867316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:10.952207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b67c94400e4fe2b9961a5275b614de'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:10.953212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b67c94400e4fe2b9961a5275b614de'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:10.955323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:10.977279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b67c94400e4fe2b9961a5275b614de'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:10.989722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b67c94400e4fe2b9961a5275b614de'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:11.000943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-67c310f2-f8a4-4182-99d4-f8f68cc46c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b67c94400e4fe2b9961a5275b614de'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:11.010398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1263/2505] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:10 2022] DELETE /identity/v3/users/e2b67c94400e4fe2b9961a5275b614de => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:11.440395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:11.441974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:11.458145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4c45-deae-4360-97e9-9dbe892ae41a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:11.565156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:11.608218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:11.609116 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:11.609588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:11.610070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] PATH_INFO: `/v3/projects/4cfaae93124b440ab469b1197ff3eb3f` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:11.612890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfaae93124b440ab469b1197ff3eb3f)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:11.615545 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:11.687747 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfaae93124b440ab469b1197ff3eb3f', 'request_id': 'req-13e62dab-c248-4e08-9559-e042a9eca0b2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:11.695769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfaae93124b440ab469b1197ff3eb3f', 'request_id': 'req-13e62dab-c248-4e08-9559-e042a9eca0b2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:11.703922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfaae93124b440ab469b1197ff3eb3f', 'request_id': 'req-13e62dab-c248-4e08-9559-e042a9eca0b2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:11.724106 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] The token cache is being invalidate because project 4cfaae93124b440ab469b1197ff3eb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:11.724553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:11.725572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13e62dab-c248-4e08-9559-e042a9eca0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:11.727859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1243/2506] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:11 2022] DELETE /identity/v3/projects/4cfaae93124b440ab469b1197ff3eb3f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:11.734436 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c5063-c976-41a2-b6dd-cd499690f713 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:11.735354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c5063-c976-41a2-b6dd-cd499690f713 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:11.735354 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c5063-c976-41a2-b6dd-cd499690f713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:11.764474 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-042c5063-c976-41a2-b6dd-cd499690f713 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:11.766028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-042c5063-c976-41a2-b6dd-cd499690f713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:11.854899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1264/2507] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:11.866048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a8398-9ade-441a-84b9-059f1e61fc71 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:11.866728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a8398-9ade-441a-84b9-059f1e61fc71 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:11.867125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a8398-9ade-441a-84b9-059f1e61fc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:11.904645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f61a8398-9ade-441a-84b9-059f1e61fc71 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:11.906188 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f61a8398-9ade-441a-84b9-059f1e61fc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:11.916897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1244/2508] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:11.923187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c5063-c976-41a2-b6dd-cd499690f713 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:11.942333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c5063-c976-41a2-b6dd-cd499690f713 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:11.949893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4506a-967a-4323-a030-58b7b6b514a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:11.950984 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4506a-967a-4323-a030-58b7b6b514a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:11.951514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4506a-967a-4323-a030-58b7b6b514a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:11.951977 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4506a-967a-4323-a030-58b7b6b514a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:11.953204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4506a-967a-4323-a030-58b7b6b514a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:42:11.953760 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4506a-967a-4323-a030-58b7b6b514a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:11.957190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4506a-967a-4323-a030-58b7b6b514a9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:11.979133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1265/2509] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:42:11.984455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a8398-9ade-441a-84b9-059f1e61fc71 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:11.998357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a8398-9ade-441a-84b9-059f1e61fc71 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:12.006404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c0618-29d6-44db-b8c5-43f5bd99fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:12.007123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c0618-29d6-44db-b8c5-43f5bd99fd9f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.007568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c0618-29d6-44db-b8c5-43f5bd99fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.007892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c0618-29d6-44db-b8c5-43f5bd99fd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.008900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c0618-29d6-44db-b8c5-43f5bd99fd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:12.011541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c0618-29d6-44db-b8c5-43f5bd99fd9f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:12.050284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1245/2510] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:11 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:12.055703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4506a-967a-4323-a030-58b7b6b514a9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:12.069499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4506a-967a-4323-a030-58b7b6b514a9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:12.153444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce934ea-4cf4-4567-a17e-8ed13b7f2a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:12.154098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce934ea-4cf4-4567-a17e-8ed13b7f2a15 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.154373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce934ea-4cf4-4567-a17e-8ed13b7f2a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.154640 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce934ea-4cf4-4567-a17e-8ed13b7f2a15 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.155341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce934ea-4cf4-4567-a17e-8ed13b7f2a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:12.157866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce934ea-4cf4-4567-a17e-8ed13b7f2a15 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:12.197284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1266/2511] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:12 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:42:12.197456 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c0618-29d6-44db-b8c5-43f5bd99fd9f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:12.213726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c0618-29d6-44db-b8c5-43f5bd99fd9f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:12.214208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce934ea-4cf4-4567-a17e-8ed13b7f2a15 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:12.217002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6ce934ea-4cf4-4567-a17e-8ed13b7f2a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:12.219945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4205-fcd7-4829-9e72-fc035530f000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:12.220876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4205-fcd7-4829-9e72-fc035530f000 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.221292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4205-fcd7-4829-9e72-fc035530f000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.221866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4205-fcd7-4829-9e72-fc035530f000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.222775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d4205-fcd7-4829-9e72-fc035530f000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:12.224886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d4205-fcd7-4829-9e72-fc035530f000 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:12.242505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1246/2512] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:12.245067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4205-fcd7-4829-9e72-fc035530f000 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:12.260563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4205-fcd7-4829-9e72-fc035530f000 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:12.266858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08ff8b-797f-4df8-8e8b-af3f0136333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:12.267796 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08ff8b-797f-4df8-8e8b-af3f0136333f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.268012 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08ff8b-797f-4df8-8e8b-af3f0136333f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.268445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08ff8b-797f-4df8-8e8b-af3f0136333f admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.269142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08ff8b-797f-4df8-8e8b-af3f0136333f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:12.270836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08ff8b-797f-4df8-8e8b-af3f0136333f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:12.283865 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1247/2513] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:12.289030 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08ff8b-797f-4df8-8e8b-af3f0136333f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:12.300295 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:12.301756 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08ff8b-797f-4df8-8e8b-af3f0136333f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:12.310903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c946c-d568-426d-bc4d-48f671307e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:12.311579 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c946c-d568-426d-bc4d-48f671307e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.311850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c946c-d568-426d-bc4d-48f671307e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.312118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c946c-d568-426d-bc4d-48f671307e08 admin admin] PATH_INFO: `/v3/projects/097359f0dcfd4d289f56c08aaa025fad/users/01a1bb68c2294c6fb7806abf7349bd56/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.322315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce934ea-4cf4-4567-a17e-8ed13b7f2a15 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:12.328247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:12.328901 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.329177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.329533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.331829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c946c-d568-426d-bc4d-48f671307e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097359f0dcfd4d289f56c08aaa025fad, user_id=01a1bb68c2294c6fb7806abf7349bd56, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:12.332091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:12.335624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c946c-d568-426d-bc4d-48f671307e08 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:12.359215 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1248/2514] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:12 2022] PUT /identity/v3/projects/097359f0dcfd4d289f56c08aaa025fad/users/01a1bb68c2294c6fb7806abf7349bd56/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:12.366111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bcefe-5517-4a1c-9dcc-16ab6958b952 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.366577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bcefe-5517-4a1c-9dcc-16ab6958b952 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.367094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bcefe-5517-4a1c-9dcc-16ab6958b952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.389209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-648bcefe-5517-4a1c-9dcc-16ab6958b952 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:12.390488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-648bcefe-5517-4a1c-9dcc-16ab6958b952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:12.439406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:12.441239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:12.459349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1267/2515] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:42:12.467876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:12.480038 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1249/2516] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:12.492583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:12.495437 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:12.634795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dbf58-46ff-4f66-ba20-e1648078e0b8 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:12.750892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c04d2-df3c-40d0-8f58-414013a0dcfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:12.753830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c04d2-df3c-40d0-8f58-414013a0dcfa service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.754376 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c04d2-df3c-40d0-8f58-414013a0dcfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.754886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c04d2-df3c-40d0-8f58-414013a0dcfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.784974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c04d2-df3c-40d0-8f58-414013a0dcfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:12.788343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c04d2-df3c-40d0-8f58-414013a0dcfa service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:12.810147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1268/2517] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:13.868132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90f650-d13e-4aae-af84-eee8a9bef766 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:13.869051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90f650-d13e-4aae-af84-eee8a9bef766 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:13.869262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90f650-d13e-4aae-af84-eee8a9bef766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:13.920960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8c90f650-d13e-4aae-af84-eee8a9bef766 None None] MFA Rules not processed for user `01a1bb68c2294c6fb7806abf7349bd56`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:13.923376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8c90f650-d13e-4aae-af84-eee8a9bef766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:14.078129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1250/2518] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:14.085701 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c04d2-df3c-40d0-8f58-414013a0dcfa service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:14.103412 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c04d2-df3c-40d0-8f58-414013a0dcfa service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:14.111537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d688c77-52d7-4c2d-acb1-e01dac1f4735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:14.112521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d688c77-52d7-4c2d-acb1-e01dac1f4735 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.112934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d688c77-52d7-4c2d-acb1-e01dac1f4735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.113379 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d688c77-52d7-4c2d-acb1-e01dac1f4735 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.114464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d688c77-52d7-4c2d-acb1-e01dac1f4735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:14.118118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d688c77-52d7-4c2d-acb1-e01dac1f4735 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:14.182894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1269/2519] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:14 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:42:14.190234 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90f650-d13e-4aae-af84-eee8a9bef766 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:14.211841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90f650-d13e-4aae-af84-eee8a9bef766 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:14.322609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b72fb0-16d7-4a96-9544-200714c1ab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:14.323644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72fb0-16d7-4a96-9544-200714c1ab4f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.324154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72fb0-16d7-4a96-9544-200714c1ab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.324598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b72fb0-16d7-4a96-9544-200714c1ab4f admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.325660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b72fb0-16d7-4a96-9544-200714c1ab4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:14.329212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b72fb0-16d7-4a96-9544-200714c1ab4f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:14.359173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1251/2520] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:14 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:14.364513 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d688c77-52d7-4c2d-acb1-e01dac1f4735 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:14.384900 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d688c77-52d7-4c2d-acb1-e01dac1f4735 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:14.393677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75076-5df5-4e8a-99ac-4371efb94a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:14.395185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75076-5df5-4e8a-99ac-4371efb94a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.395829 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75076-5df5-4e8a-99ac-4371efb94a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.396821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75076-5df5-4e8a-99ac-4371efb94a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.398316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c75076-5df5-4e8a-99ac-4371efb94a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:14.402147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c75076-5df5-4e8a-99ac-4371efb94a73 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:14.428736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1270/2521] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:14.433934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b72fb0-16d7-4a96-9544-200714c1ab4f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:14.445720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b72fb0-16d7-4a96-9544-200714c1ab4f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:14.450563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d8e0f-37fd-42a1-9aa2-02493ffb9155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:14.451314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8e0f-37fd-42a1-9aa2-02493ffb9155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.451767 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8e0f-37fd-42a1-9aa2-02493ffb9155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.452048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8e0f-37fd-42a1-9aa2-02493ffb9155 admin admin] PATH_INFO: `/v3/projects/9a5aa66649ca47108abc62d37bd80381/users/ce6ca99913bd42feb23aecc903bf3d0f/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.472957 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d8e0f-37fd-42a1-9aa2-02493ffb9155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5aa66649ca47108abc62d37bd80381, user_id=ce6ca99913bd42feb23aecc903bf3d0f, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:14.475911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d8e0f-37fd-42a1-9aa2-02493ffb9155 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:14.493860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1252/2522] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:14 2022] PUT /identity/v3/projects/9a5aa66649ca47108abc62d37bd80381/users/ce6ca99913bd42feb23aecc903bf3d0f/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:14.499213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75076-5df5-4e8a-99ac-4371efb94a73 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:14.523877 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75076-5df5-4e8a-99ac-4371efb94a73 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:14.531901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512439-eba0-4e21-8c19-fe51cf510283 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.532347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512439-eba0-4e21-8c19-fe51cf510283 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.533486 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512439-eba0-4e21-8c19-fe51cf510283 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.536118 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1253/2523] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:42:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:42:14.545576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4390c-f19c-45bc-92a1-26a0c6146b73 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.546893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4390c-f19c-45bc-92a1-26a0c6146b73 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.547465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4390c-f19c-45bc-92a1-26a0c6146b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.553660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:14.612163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7ec4390c-f19c-45bc-92a1-26a0c6146b73 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:14.618396 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7ec4390c-f19c-45bc-92a1-26a0c6146b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:14.650518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61722e-e733-4c8b-ae31-8c3bf9747df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:14.651620 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61722e-e733-4c8b-ae31-8c3bf9747df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.652111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61722e-e733-4c8b-ae31-8c3bf9747df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.652595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61722e-e733-4c8b-ae31-8c3bf9747df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.653771 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61722e-e733-4c8b-ae31-8c3bf9747df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:14.656964 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61722e-e733-4c8b-ae31-8c3bf9747df0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:14.678747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1271/2524] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:14.685205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61722e-e733-4c8b-ae31-8c3bf9747df0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:14.701753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61722e-e733-4c8b-ae31-8c3bf9747df0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:14.711442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b93b-244a-4775-b407-a3b563b6a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:14.712131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b93b-244a-4775-b407-a3b563b6a52e admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.712400 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b93b-244a-4775-b407-a3b563b6a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.712669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b93b-244a-4775-b407-a3b563b6a52e admin admin] PATH_INFO: `/v3/projects/9a5aa66649ca47108abc62d37bd80381/users/ce6ca99913bd42feb23aecc903bf3d0f/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.714852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46b93b-244a-4775-b407-a3b563b6a52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5aa66649ca47108abc62d37bd80381, user_id=ce6ca99913bd42feb23aecc903bf3d0f, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:14.718368 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46b93b-244a-4775-b407-a3b563b6a52e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:14.721407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:14.738879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1272/2525] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:14 2022] PUT /identity/v3/projects/9a5aa66649ca47108abc62d37bd80381/users/ce6ca99913bd42feb23aecc903bf3d0f/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:14.779813 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1254/2526] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:42:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:14.797248 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b93b-244a-4775-b407-a3b563b6a52e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:14.799973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cc46b93b-244a-4775-b407-a3b563b6a52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:14.892713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b93b-244a-4775-b407-a3b563b6a52e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:14.897327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14036e43-1aea-4684-b532-9f49b43465de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c0b33c2c7947c59ebf8da17abbd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:14.898160 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14036e43-1aea-4684-b532-9f49b43465de service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.898547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14036e43-1aea-4684-b532-9f49b43465de service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.898995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14036e43-1aea-4684-b532-9f49b43465de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:15.011658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14036e43-1aea-4684-b532-9f49b43465de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:15.014587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14036e43-1aea-4684-b532-9f49b43465de service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:15.034450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1273/2527] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:15.133729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0a7a-f180-42c9-8f97-f9c01c8d21b3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:15.134583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0a7a-f180-42c9-8f97-f9c01c8d21b3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:15.134583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0a7a-f180-42c9-8f97-f9c01c8d21b3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:15.136105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1255/2528] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:15.145228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92d72e-b376-477b-a31f-70d23b8afe6f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:15.145911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92d72e-b376-477b-a31f-70d23b8afe6f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:15.146051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92d72e-b376-477b-a31f-70d23b8afe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:15.184403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ec92d72e-b376-477b-a31f-70d23b8afe6f None None] MFA Rules not processed for user `0e7bc56706f2491b92f5745a0fbc2acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:15.185868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ec92d72e-b376-477b-a31f-70d23b8afe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:15.254918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:15.285337 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1274/2529] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:42:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:15.302511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f0a7a-f180-42c9-8f97-f9c01c8d21b3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:15.318070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f0a7a-f180-42c9-8f97-f9c01c8d21b3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:15.323073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c75643-543b-47e9-83fa-f0b51282ee63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:15.323825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c75643-543b-47e9-83fa-f0b51282ee63 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:15.324574 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c75643-543b-47e9-83fa-f0b51282ee63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:15.324932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c75643-543b-47e9-83fa-f0b51282ee63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:15.334794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c75643-543b-47e9-83fa-f0b51282ee63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:15.337113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c75643-543b-47e9-83fa-f0b51282ee63 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:15.349194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1256/2530] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:15.992820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c170e73-02ad-4c66-8662-0a7d117ad1ca None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:15.993166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c170e73-02ad-4c66-8662-0a7d117ad1ca None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:15.993358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c170e73-02ad-4c66-8662-0a7d117ad1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:16.034406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0c170e73-02ad-4c66-8662-0a7d117ad1ca None None] MFA Rules not processed for user `ce6ca99913bd42feb23aecc903bf3d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:16.035849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0c170e73-02ad-4c66-8662-0a7d117ad1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:16.151270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1275/2531] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:16.163509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e3ce-b18d-429d-b8dd-125499f6baa4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:16.164361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e3ce-b18d-429d-b8dd-125499f6baa4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:16.164361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e3ce-b18d-429d-b8dd-125499f6baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:16.199298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d267e3ce-b18d-429d-b8dd-125499f6baa4 None None] MFA Rules not processed for user `01a1bb68c2294c6fb7806abf7349bd56`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:16.201794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d267e3ce-b18d-429d-b8dd-125499f6baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:16.307151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1257/2532] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:16.320067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c170e73-02ad-4c66-8662-0a7d117ad1ca None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:16.321577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0c170e73-02ad-4c66-8662-0a7d117ad1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:16.340329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c170e73-02ad-4c66-8662-0a7d117ad1ca None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:16.348649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e489da1-67b0-4551-804c-5bc747ea7de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:16.349652 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e489da1-67b0-4551-804c-5bc747ea7de0 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:16.350113 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e489da1-67b0-4551-804c-5bc747ea7de0 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:16.350535 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e489da1-67b0-4551-804c-5bc747ea7de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:16.365807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e489da1-67b0-4551-804c-5bc747ea7de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:16.368841 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e489da1-67b0-4551-804c-5bc747ea7de0 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:16.385820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1276/2533] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:16.479239 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55e45e-7ec3-4f8c-97ef-d3a409730808 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:16.479964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55e45e-7ec3-4f8c-97ef-d3a409730808 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:16.480253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55e45e-7ec3-4f8c-97ef-d3a409730808 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:16.481927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1258/2534] 10.222.0.78 () {54 vars in 921 bytes} [Wed Aug 24 03:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:42:16.492388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba27a8-10e3-4867-b2ef-a65c582bf6a6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:16.492759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba27a8-10e3-4867-b2ef-a65c582bf6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:16.492979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba27a8-10e3-4867-b2ef-a65c582bf6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:16.517395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-daba27a8-10e3-4867-b2ef-a65c582bf6a6 None None] MFA Rules not processed for user `438786dead414066a6ef101a2493fb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:16.518378 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-daba27a8-10e3-4867-b2ef-a65c582bf6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:16.532185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1277/2535] 10.222.0.78 () {58 vars in 1018 bytes} [Wed Aug 24 03:42:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:16.557436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55e45e-7ec3-4f8c-97ef-d3a409730808 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:16.576860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55e45e-7ec3-4f8c-97ef-d3a409730808 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:16.583515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e438646-5550-42a6-b2f3-ac4919c25c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:16.584479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e438646-5550-42a6-b2f3-ac4919c25c0f service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:16.584910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e438646-5550-42a6-b2f3-ac4919c25c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:16.585323 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e438646-5550-42a6-b2f3-ac4919c25c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:16.607280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e438646-5550-42a6-b2f3-ac4919c25c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:16.610108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e438646-5550-42a6-b2f3-ac4919c25c0f service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:16.635000 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1259/2536] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:42:24.805086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a3c1b-61a8-49c5-8b95-cfdd12a4cfd9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:24.806097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a3c1b-61a8-49c5-8b95-cfdd12a4cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:24.806202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a3c1b-61a8-49c5-8b95-cfdd12a4cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:24.835769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-821a3c1b-61a8-49c5-8b95-cfdd12a4cfd9 None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:24.837755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-821a3c1b-61a8-49c5-8b95-cfdd12a4cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:24.910876 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1278/2537] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:42:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:24.944316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e438646-5550-42a6-b2f3-ac4919c25c0f service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:24.946071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4e438646-5550-42a6-b2f3-ac4919c25c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:25.043385 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e438646-5550-42a6-b2f3-ac4919c25c0f service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:25.053268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536f387-e9fa-4c26-a090-ca62e6d395d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:25.054587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536f387-e9fa-4c26-a090-ca62e6d395d6 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:25.055048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536f387-e9fa-4c26-a090-ca62e6d395d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:25.055777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536f387-e9fa-4c26-a090-ca62e6d395d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:25.071942 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536f387-e9fa-4c26-a090-ca62e6d395d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:25.074989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536f387-e9fa-4c26-a090-ca62e6d395d6 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:25.090534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1260/2538] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:42:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:26.658894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a3c1b-61a8-49c5-8b95-cfdd12a4cfd9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:26.661266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-821a3c1b-61a8-49c5-8b95-cfdd12a4cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:26.828751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a3c1b-61a8-49c5-8b95-cfdd12a4cfd9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:26.837348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:26.838542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:26.839081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:26.839550 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] PATH_INFO: `/v3/users/392897bfeb38487eab471734d90c2a9e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:26.841930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=392897bfeb38487eab471734d90c2a9e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:26.846494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:26.852046 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:26.972669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392897bfeb38487eab471734d90c2a9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:26.973748 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392897bfeb38487eab471734d90c2a9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:27.009793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392897bfeb38487eab471734d90c2a9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:27.028087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392897bfeb38487eab471734d90c2a9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:27.047686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392897bfeb38487eab471734d90c2a9e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:27.061276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1279/2539] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:26 2022] DELETE /identity/v3/users/392897bfeb38487eab471734d90c2a9e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:27.069048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb057fa-a87b-4c25-b970-b17af0d5ab77 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:27.069893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb057fa-a87b-4c25-b970-b17af0d5ab77 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:27.069893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb057fa-a87b-4c25-b970-b17af0d5ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:27.114225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fbb057fa-a87b-4c25-b970-b17af0d5ab77 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:27.118587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fbb057fa-a87b-4c25-b970-b17af0d5ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:27.195958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:27.265950 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1261/2540] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:27.280621 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:27.282350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:27.391784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394adf15-3496-44e6-a913-5dc82dab4a3d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:27.398751 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f33cd-2020-4121-9ff8-32687583608a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:27.399833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f33cd-2020-4121-9ff8-32687583608a service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:27.400329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f33cd-2020-4121-9ff8-32687583608a service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:27.400879 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f33cd-2020-4121-9ff8-32687583608a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:27.423829 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f33cd-2020-4121-9ff8-32687583608a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:27.427142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f33cd-2020-4121-9ff8-32687583608a service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:27.461868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1280/2541] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:28.206417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb057fa-a87b-4c25-b970-b17af0d5ab77 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:28.210533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fbb057fa-a87b-4c25-b970-b17af0d5ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:28.234646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb057fa-a87b-4c25-b970-b17af0d5ab77 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:28.248417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:28.250122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:28.250561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:28.250909 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] PATH_INFO: `/v3/projects/5fe5763740034de28f939c4007e2785e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:28.252711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe5763740034de28f939c4007e2785e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:28.254888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:28.344819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe5763740034de28f939c4007e2785e', 'request_id': 'req-98efe518-7f76-4c6b-9d62-b47e21ae437e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.354446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe5763740034de28f939c4007e2785e', 'request_id': 'req-98efe518-7f76-4c6b-9d62-b47e21ae437e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.363037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe5763740034de28f939c4007e2785e', 'request_id': 'req-98efe518-7f76-4c6b-9d62-b47e21ae437e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.383024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] The token cache is being invalidate because project 5fe5763740034de28f939c4007e2785e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:28.383388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.384389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.386263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1262/2542] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:28 2022] DELETE /identity/v3/projects/5fe5763740034de28f939c4007e2785e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:28.391045 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f33cd-2020-4121-9ff8-32687583608a service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:28.403279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f33cd-2020-4121-9ff8-32687583608a service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:28.486674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:28.487788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:28.488267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:28.488745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] PATH_INFO: `/v3/users/9462b98fb8cd422d8673f4ae09ee7036` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:28.490932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9462b98fb8cd422d8673f4ae09ee7036)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:28.494828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:28.546956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:28.586682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9462b98fb8cd422d8673f4ae09ee7036'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.588377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9462b98fb8cd422d8673f4ae09ee7036'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.624297 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9462b98fb8cd422d8673f4ae09ee7036'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.630152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9462b98fb8cd422d8673f4ae09ee7036'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.641062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0dae437c-bdd2-4d97-b547-03a2fccf2eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9462b98fb8cd422d8673f4ae09ee7036'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:28.649533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1281/2543] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:28 2022] DELETE /identity/v3/users/9462b98fb8cd422d8673f4ae09ee7036 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:29.364669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:29.366533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:29.424954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe518-7f76-4c6b-9d62-b47e21ae437e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:29.558783 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:29.559448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:29.559819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:29.560263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] PATH_INFO: `/v3/projects/8b4fe92e66db4bad9a12db2d5a4e6460` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:29.561561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4fe92e66db4bad9a12db2d5a4e6460)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:29.563936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:29.655872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4fe92e66db4bad9a12db2d5a4e6460', 'request_id': 'req-e2ead05a-c850-4724-970d-6aeada9886b9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:29.670056 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4fe92e66db4bad9a12db2d5a4e6460', 'request_id': 'req-e2ead05a-c850-4724-970d-6aeada9886b9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:29.678881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:29.681535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4fe92e66db4bad9a12db2d5a4e6460', 'request_id': 'req-e2ead05a-c850-4724-970d-6aeada9886b9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:29.744116 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] The token cache is being invalidate because project 8b4fe92e66db4bad9a12db2d5a4e6460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:29.744983 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:29.746394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e2ead05a-c850-4724-970d-6aeada9886b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:29.749810 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1263/2544] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:29 2022] DELETE /identity/v3/projects/8b4fe92e66db4bad9a12db2d5a4e6460 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:29.755863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b8074-5853-4a63-8de1-ab3a68ab3c12 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:29.756728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b8074-5853-4a63-8de1-ab3a68ab3c12 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:29.756728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b8074-5853-4a63-8de1-ab3a68ab3c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:29.809188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9c0b8074-5853-4a63-8de1-ab3a68ab3c12 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:29.812821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9c0b8074-5853-4a63-8de1-ab3a68ab3c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:29.901657 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1282/2545] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:29.911542 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac048-732b-4ddd-bef4-07225ec4470d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:29.912035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac048-732b-4ddd-bef4-07225ec4470d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:29.912525 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac048-732b-4ddd-bef4-07225ec4470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:29.946898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-06dac048-732b-4ddd-bef4-07225ec4470d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:29.949024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-06dac048-732b-4ddd-bef4-07225ec4470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:29.963633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1264/2546] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:29.969013 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b8074-5853-4a63-8de1-ab3a68ab3c12 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:29.979905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b8074-5853-4a63-8de1-ab3a68ab3c12 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:29.984912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1da79-207d-4dda-93fc-55e4f1d50a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:29.985574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1da79-207d-4dda-93fc-55e4f1d50a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:29.985844 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1da79-207d-4dda-93fc-55e4f1d50a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:29.986192 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1da79-207d-4dda-93fc-55e4f1d50a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:29.987028 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1da79-207d-4dda-93fc-55e4f1d50a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:42:29.987328 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1da79-207d-4dda-93fc-55e4f1d50a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:29.988943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1da79-207d-4dda-93fc-55e4f1d50a83 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:30.005531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1283/2547] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:42:30.009435 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dac048-732b-4ddd-bef4-07225ec4470d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:30.020133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dac048-732b-4ddd-bef4-07225ec4470d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:30.026256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0785f-9c04-4957-b9f5-5b0d24399706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:30.027179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0785f-9c04-4957-b9f5-5b0d24399706 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:30.027179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0785f-9c04-4957-b9f5-5b0d24399706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:30.027535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0785f-9c04-4957-b9f5-5b0d24399706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:30.028079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0785f-9c04-4957-b9f5-5b0d24399706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:30.030166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0785f-9c04-4957-b9f5-5b0d24399706 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:30.099560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1265/2548] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:30 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:30.104683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1da79-207d-4dda-93fc-55e4f1d50a83 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:30.116593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1da79-207d-4dda-93fc-55e4f1d50a83 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:30.210179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f311-e17d-4721-a9b9-eb349eff38d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:30.210913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f311-e17d-4721-a9b9-eb349eff38d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:30.211217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f311-e17d-4721-a9b9-eb349eff38d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:30.211485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f311-e17d-4721-a9b9-eb349eff38d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:30.212218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9f311-e17d-4721-a9b9-eb349eff38d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:30.214938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9f311-e17d-4721-a9b9-eb349eff38d8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:30.241593 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1284/2549] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:30 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:30.246796 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0785f-9c04-4957-b9f5-5b0d24399706 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:30.262037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0785f-9c04-4957-b9f5-5b0d24399706 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:30.273738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991df2c2-b704-46c3-9840-693ffb34cd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:30.275437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df2c2-b704-46c3-9840-693ffb34cd8b admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:30.276203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df2c2-b704-46c3-9840-693ffb34cd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:30.276945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df2c2-b704-46c3-9840-693ffb34cd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:30.278276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991df2c2-b704-46c3-9840-693ffb34cd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:30.280932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991df2c2-b704-46c3-9840-693ffb34cd8b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:30.299019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1266/2550] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:30.306463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f311-e17d-4721-a9b9-eb349eff38d8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:30.323234 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f311-e17d-4721-a9b9-eb349eff38d8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:30.331228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f387f3c-b6e6-4f9d-9a7d-5bfaf9621340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:30.332573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f387f3c-b6e6-4f9d-9a7d-5bfaf9621340 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:30.336239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f387f3c-b6e6-4f9d-9a7d-5bfaf9621340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:30.337077 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f387f3c-b6e6-4f9d-9a7d-5bfaf9621340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:30.338447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f387f3c-b6e6-4f9d-9a7d-5bfaf9621340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:30.340579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f387f3c-b6e6-4f9d-9a7d-5bfaf9621340 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:30.358599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1285/2551] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:30.364027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991df2c2-b704-46c3-9840-693ffb34cd8b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:30.375145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991df2c2-b704-46c3-9840-693ffb34cd8b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:30.383412 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767b60e-8a79-48ec-a9f5-0b3c865ee71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:30.384755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767b60e-8a79-48ec-a9f5-0b3c865ee71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:30.385437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767b60e-8a79-48ec-a9f5-0b3c865ee71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:30.385885 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767b60e-8a79-48ec-a9f5-0b3c865ee71f admin admin] PATH_INFO: `/v3/projects/62d09ed48e2e4a36b48430189e551901/users/074338d33743494399a4ea4dda0872a3/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:30.405939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767b60e-8a79-48ec-a9f5-0b3c865ee71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d09ed48e2e4a36b48430189e551901, user_id=074338d33743494399a4ea4dda0872a3, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:30.410548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767b60e-8a79-48ec-a9f5-0b3c865ee71f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:30.437774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1267/2552] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:30 2022] PUT /identity/v3/projects/62d09ed48e2e4a36b48430189e551901/users/074338d33743494399a4ea4dda0872a3/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:30.449811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba33c55-d0c0-49ae-9828-a70d67596582 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:30.450302 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba33c55-d0c0-49ae-9828-a70d67596582 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:30.450577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba33c55-d0c0-49ae-9828-a70d67596582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:30.482245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:30.502595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-aba33c55-d0c0-49ae-9828-a70d67596582 None None] MFA Rules not processed for user `074338d33743494399a4ea4dda0872a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:30.505406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-aba33c55-d0c0-49ae-9828-a70d67596582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:30.684158 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1286/2553] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:30.686042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767b60e-8a79-48ec-a9f5-0b3c865ee71f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:30.861647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767b60e-8a79-48ec-a9f5-0b3c865ee71f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:30.867681 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557deb7-e59f-41a6-b373-6da6e4de7794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:30.868712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557deb7-e59f-41a6-b373-6da6e4de7794 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:30.868907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557deb7-e59f-41a6-b373-6da6e4de7794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:30.869158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557deb7-e59f-41a6-b373-6da6e4de7794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:30.869817 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557deb7-e59f-41a6-b373-6da6e4de7794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:30.871901 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557deb7-e59f-41a6-b373-6da6e4de7794 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:30.933256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1268/2554] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:30 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:42:30.939927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba33c55-d0c0-49ae-9828-a70d67596582 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:30.979043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba33c55-d0c0-49ae-9828-a70d67596582 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:31.152429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca1fec-60de-4b18-b631-cb105dc7016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:31.153232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca1fec-60de-4b18-b631-cb105dc7016e admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.153645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca1fec-60de-4b18-b631-cb105dc7016e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.154069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca1fec-60de-4b18-b631-cb105dc7016e admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.155312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca1fec-60de-4b18-b631-cb105dc7016e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:31.158140 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca1fec-60de-4b18-b631-cb105dc7016e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:31.201867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1287/2555] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:30 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:31.203072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557deb7-e59f-41a6-b373-6da6e4de7794 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:31.223267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557deb7-e59f-41a6-b373-6da6e4de7794 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:31.230406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291984-e4e6-4b93-9005-98c917262040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:31.231191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291984-e4e6-4b93-9005-98c917262040 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.231447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291984-e4e6-4b93-9005-98c917262040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.231727 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291984-e4e6-4b93-9005-98c917262040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.232635 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291984-e4e6-4b93-9005-98c917262040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:31.234743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291984-e4e6-4b93-9005-98c917262040 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:31.248145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1269/2556] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:31.253979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca1fec-60de-4b18-b631-cb105dc7016e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:31.265180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca1fec-60de-4b18-b631-cb105dc7016e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:31.270609 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023952b5-e1c1-4eb0-a51d-5545b87a752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:31.271417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023952b5-e1c1-4eb0-a51d-5545b87a752a admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.271660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023952b5-e1c1-4eb0-a51d-5545b87a752a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.271973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023952b5-e1c1-4eb0-a51d-5545b87a752a admin admin] PATH_INFO: `/v3/projects/63ab0b0589f14be088f85b2063a80ccd/users/ed0c1384ad034b9f832f92a39c81cffe/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.289805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023952b5-e1c1-4eb0-a51d-5545b87a752a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ab0b0589f14be088f85b2063a80ccd, user_id=ed0c1384ad034b9f832f92a39c81cffe, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:31.293016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023952b5-e1c1-4eb0-a51d-5545b87a752a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:31.310007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1288/2557] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:31 2022] PUT /identity/v3/projects/63ab0b0589f14be088f85b2063a80ccd/users/ed0c1384ad034b9f832f92a39c81cffe/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:31.315620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291984-e4e6-4b93-9005-98c917262040 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:31.327537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291984-e4e6-4b93-9005-98c917262040 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:31.403572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:31.423123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5449ac6-a746-4226-8b5e-713992b22404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:31.424588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449ac6-a746-4226-8b5e-713992b22404 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.425076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449ac6-a746-4226-8b5e-713992b22404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.425660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449ac6-a746-4226-8b5e-713992b22404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.427400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5449ac6-a746-4226-8b5e-713992b22404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:31.431312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5449ac6-a746-4226-8b5e-713992b22404 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:31.454508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1270/2558] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:31.459220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023952b5-e1c1-4eb0-a51d-5545b87a752a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:31.472683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023952b5-e1c1-4eb0-a51d-5545b87a752a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:31.478117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f47113-2fcc-4b59-a163-dc7c628053f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:31.478913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f47113-2fcc-4b59-a163-dc7c628053f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.479302 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f47113-2fcc-4b59-a163-dc7c628053f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.479569 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f47113-2fcc-4b59-a163-dc7c628053f5 admin admin] PATH_INFO: `/v3/projects/63ab0b0589f14be088f85b2063a80ccd/users/ed0c1384ad034b9f832f92a39c81cffe/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.482186 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f47113-2fcc-4b59-a163-dc7c628053f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ab0b0589f14be088f85b2063a80ccd, user_id=ed0c1384ad034b9f832f92a39c81cffe, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:31.485475 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f47113-2fcc-4b59-a163-dc7c628053f5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:31.519079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1289/2559] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:31 2022] PUT /identity/v3/projects/63ab0b0589f14be088f85b2063a80ccd/users/ed0c1384ad034b9f832f92a39c81cffe/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:31.529956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b8992-c60f-40e1-9a51-c2e0c79d87e7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.530102 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b8992-c60f-40e1-9a51-c2e0c79d87e7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.530503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b8992-c60f-40e1-9a51-c2e0c79d87e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.571611 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-885b8992-c60f-40e1-9a51-c2e0c79d87e7 None None] MFA Rules not processed for user `ed0c1384ad034b9f832f92a39c81cffe`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:31.573134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-885b8992-c60f-40e1-9a51-c2e0c79d87e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:31.695247 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1271/2560] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:31.717291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f47113-2fcc-4b59-a163-dc7c628053f5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:31.720165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-96f47113-2fcc-4b59-a163-dc7c628053f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:31.874824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f47113-2fcc-4b59-a163-dc7c628053f5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:31.892029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012420ba-c4bf-45a1-a803-939b3ef65e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:31.894411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012420ba-c4bf-45a1-a803-939b3ef65e0b service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.895088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012420ba-c4bf-45a1-a803-939b3ef65e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.895643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012420ba-c4bf-45a1-a803-939b3ef65e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.903502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:32.016571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012420ba-c4bf-45a1-a803-939b3ef65e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:32.019187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012420ba-c4bf-45a1-a803-939b3ef65e0b service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:32.029777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1290/2561] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:34.499544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b8992-c60f-40e1-9a51-c2e0c79d87e7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:34.502340 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-885b8992-c60f-40e1-9a51-c2e0c79d87e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:34.638221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b8992-c60f-40e1-9a51-c2e0c79d87e7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:34.645093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b7a84-0a14-4fbb-b84b-334ca80c7617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:34.647573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b7a84-0a14-4fbb-b84b-334ca80c7617 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:34.647573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b7a84-0a14-4fbb-b84b-334ca80c7617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:34.647573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b7a84-0a14-4fbb-b84b-334ca80c7617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:34.651765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5c3b7a84-0a14-4fbb-b84b-334ca80c7617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:34.780888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b7a84-0a14-4fbb-b84b-334ca80c7617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:34.783641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b7a84-0a14-4fbb-b84b-334ca80c7617 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:34.804572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1272/2562] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:35.024771 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012420ba-c4bf-45a1-a803-939b3ef65e0b service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:35.044068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b7a84-0a14-4fbb-b84b-334ca80c7617 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:35.052187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012420ba-c4bf-45a1-a803-939b3ef65e0b service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:35.060260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84272e23-ab5e-456f-bcde-ab45e123bdb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:35.061216 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84272e23-ab5e-456f-bcde-ab45e123bdb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:35.061628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84272e23-ab5e-456f-bcde-ab45e123bdb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:35.062048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84272e23-ab5e-456f-bcde-ab45e123bdb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:35.066432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-84272e23-ab5e-456f-bcde-ab45e123bdb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:35.073784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:35.094789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84272e23-ab5e-456f-bcde-ab45e123bdb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:35.097506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84272e23-ab5e-456f-bcde-ab45e123bdb2 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:35.118321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1291/2563] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:42:35.170447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b7a84-0a14-4fbb-b84b-334ca80c7617 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:35.178850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:35.179812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:35.180577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:35.180969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] PATH_INFO: `/v3/users/074338d33743494399a4ea4dda0872a3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:35.182912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074338d33743494399a4ea4dda0872a3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:35.186175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:35.316196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074338d33743494399a4ea4dda0872a3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:35.317299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074338d33743494399a4ea4dda0872a3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:35.318200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074338d33743494399a4ea4dda0872a3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:35.347032 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074338d33743494399a4ea4dda0872a3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:35.389366 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074338d33743494399a4ea4dda0872a3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:35.412232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1273/2564] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:35 2022] DELETE /identity/v3/users/074338d33743494399a4ea4dda0872a3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:35.418545 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2204e10-4101-4136-ae8c-ae0de35f08cb None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:35.419032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2204e10-4101-4136-ae8c-ae0de35f08cb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:35.419421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2204e10-4101-4136-ae8c-ae0de35f08cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:35.442635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d2204e10-4101-4136-ae8c-ae0de35f08cb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:35.444105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d2204e10-4101-4136-ae8c-ae0de35f08cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:35.578456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1292/2565] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:35.595294 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:35.598563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:35.707577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d37a7-2719-4699-9543-56dbc497d075 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:35.715140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbda5b-3b89-419a-932e-ec3725baa265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:35.716827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbda5b-3b89-419a-932e-ec3725baa265 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:35.717666 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbda5b-3b89-419a-932e-ec3725baa265 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:35.718439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbda5b-3b89-419a-932e-ec3725baa265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:35.741795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbda5b-3b89-419a-932e-ec3725baa265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:35.745218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbda5b-3b89-419a-932e-ec3725baa265 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:35.767784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1274/2566] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:42:36.243832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2204e10-4101-4136-ae8c-ae0de35f08cb None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:36.246530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d2204e10-4101-4136-ae8c-ae0de35f08cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:36.274583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2204e10-4101-4136-ae8c-ae0de35f08cb None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:36.285224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:36.286299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:36.286842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:36.287298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] PATH_INFO: `/v3/projects/62d09ed48e2e4a36b48430189e551901` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:36.289665 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d09ed48e2e4a36b48430189e551901)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:36.293563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:36.569732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d09ed48e2e4a36b48430189e551901', 'request_id': 'req-9b19fc76-91a3-4881-a12c-d67d921c800f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.584020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d09ed48e2e4a36b48430189e551901', 'request_id': 'req-9b19fc76-91a3-4881-a12c-d67d921c800f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.596863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d09ed48e2e4a36b48430189e551901', 'request_id': 'req-9b19fc76-91a3-4881-a12c-d67d921c800f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.614963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] The token cache is being invalidate because project 62d09ed48e2e4a36b48430189e551901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:36.615483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.616806 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.619750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1293/2567] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:36 2022] DELETE /identity/v3/projects/62d09ed48e2e4a36b48430189e551901 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:36.626232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbda5b-3b89-419a-932e-ec3725baa265 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:36.644874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbda5b-3b89-419a-932e-ec3725baa265 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:36.713582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:36.758389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:36.759441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:36.759876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:36.760292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] PATH_INFO: `/v3/users/ed0c1384ad034b9f832f92a39c81cffe` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:36.762395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0c1384ad034b9f832f92a39c81cffe)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:36.765815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:36.840857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0c1384ad034b9f832f92a39c81cffe'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.841771 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0c1384ad034b9f832f92a39c81cffe'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.842661 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0c1384ad034b9f832f92a39c81cffe'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.863535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0c1384ad034b9f832f92a39c81cffe'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.872450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62b25e05-fd34-4795-8f6a-235cfaa6c3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0c1384ad034b9f832f92a39c81cffe'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:36.890863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1275/2568] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:36 2022] DELETE /identity/v3/users/ed0c1384ad034b9f832f92a39c81cffe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:37.371364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:37.373490 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:37.393470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19fc76-91a3-4881-a12c-d67d921c800f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:37.425024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:37.519600 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:37.520708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.521187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.521663 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] PATH_INFO: `/v3/projects/63ab0b0589f14be088f85b2063a80ccd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.523847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ab0b0589f14be088f85b2063a80ccd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:37.527611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:37.615713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ab0b0589f14be088f85b2063a80ccd', 'request_id': 'req-0bc498af-d81e-4f49-88b7-bf2535c5e331'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:37.630087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ab0b0589f14be088f85b2063a80ccd', 'request_id': 'req-0bc498af-d81e-4f49-88b7-bf2535c5e331'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:37.643430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ab0b0589f14be088f85b2063a80ccd', 'request_id': 'req-0bc498af-d81e-4f49-88b7-bf2535c5e331'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:37.658250 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] The token cache is being invalidate because project 63ab0b0589f14be088f85b2063a80ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:37.658585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:37.659453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0bc498af-d81e-4f49-88b7-bf2535c5e331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:37.661424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1294/2569] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:37 2022] DELETE /identity/v3/projects/63ab0b0589f14be088f85b2063a80ccd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:37.667445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1747-0cd6-4fc4-8ca0-e0c03f52a430 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.668251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1747-0cd6-4fc4-8ca0-e0c03f52a430 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.668424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1747-0cd6-4fc4-8ca0-e0c03f52a430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.707022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c0ea1747-0cd6-4fc4-8ca0-e0c03f52a430 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:37.709001 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c0ea1747-0cd6-4fc4-8ca0-e0c03f52a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:37.815588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1276/2570] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:37.829599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e883-22be-4eca-9c1f-9eb78ec43a64 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.829922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e883-22be-4eca-9c1f-9eb78ec43a64 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.830378 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e883-22be-4eca-9c1f-9eb78ec43a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.853919 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8fb0e883-22be-4eca-9c1f-9eb78ec43a64 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:37.855353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8fb0e883-22be-4eca-9c1f-9eb78ec43a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:37.865025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1295/2571] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:37.871080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1747-0cd6-4fc4-8ca0-e0c03f52a430 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:37.888540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1747-0cd6-4fc4-8ca0-e0c03f52a430 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:37.897174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d86ff-804e-4cf3-abf1-96d23d3098a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:37.898350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d86ff-804e-4cf3-abf1-96d23d3098a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.898908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d86ff-804e-4cf3-abf1-96d23d3098a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.899400 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d86ff-804e-4cf3-abf1-96d23d3098a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.900738 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d86ff-804e-4cf3-abf1-96d23d3098a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:42:37.901293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d86ff-804e-4cf3-abf1-96d23d3098a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:37.904623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d86ff-804e-4cf3-abf1-96d23d3098a6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:37.929109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1277/2572] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:42:37.936577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e883-22be-4eca-9c1f-9eb78ec43a64 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:37.954908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e883-22be-4eca-9c1f-9eb78ec43a64 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:37.965168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc367cad-828b-4d9a-aff5-d56745686996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:37.966885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc367cad-828b-4d9a-aff5-d56745686996 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.966885 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc367cad-828b-4d9a-aff5-d56745686996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.967732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc367cad-828b-4d9a-aff5-d56745686996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.968671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc367cad-828b-4d9a-aff5-d56745686996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:37.972539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc367cad-828b-4d9a-aff5-d56745686996 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:38.011983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1296/2573] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:37 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:38.016812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d86ff-804e-4cf3-abf1-96d23d3098a6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:38.033739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d86ff-804e-4cf3-abf1-96d23d3098a6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:38.099280 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:38.122964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8e6a7-1e27-485e-a3b8-20ad639cbaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:38.123781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8e6a7-1e27-485e-a3b8-20ad639cbaee admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.124154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8e6a7-1e27-485e-a3b8-20ad639cbaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.124539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8e6a7-1e27-485e-a3b8-20ad639cbaee admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.125308 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8e6a7-1e27-485e-a3b8-20ad639cbaee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:38.127947 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8e6a7-1e27-485e-a3b8-20ad639cbaee admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:38.156142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1278/2574] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:38 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:42:38.163083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc367cad-828b-4d9a-aff5-d56745686996 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:38.181949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc367cad-828b-4d9a-aff5-d56745686996 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:38.191638 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82344d5-cdf4-4cb3-8214-d13c42c5c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:38.192714 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82344d5-cdf4-4cb3-8214-d13c42c5c6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.193180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82344d5-cdf4-4cb3-8214-d13c42c5c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.193636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82344d5-cdf4-4cb3-8214-d13c42c5c6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.194856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82344d5-cdf4-4cb3-8214-d13c42c5c6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:38.198015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82344d5-cdf4-4cb3-8214-d13c42c5c6aa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:38.219444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1297/2575] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:38.225993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8e6a7-1e27-485e-a3b8-20ad639cbaee admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:38.244728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8e6a7-1e27-485e-a3b8-20ad639cbaee admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:38.253117 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8506b-11f9-4bfb-a222-3525b65d947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:38.254181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8506b-11f9-4bfb-a222-3525b65d947b admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.254683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8506b-11f9-4bfb-a222-3525b65d947b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.255159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8506b-11f9-4bfb-a222-3525b65d947b admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.256341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8506b-11f9-4bfb-a222-3525b65d947b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:38.259450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8506b-11f9-4bfb-a222-3525b65d947b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:38.281430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1279/2576] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:38.288102 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82344d5-cdf4-4cb3-8214-d13c42c5c6aa admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:38.300813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82344d5-cdf4-4cb3-8214-d13c42c5c6aa admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:38.308580 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9663f-520a-4b80-96a2-f31efb45b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:38.309846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9663f-520a-4b80-96a2-f31efb45b695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.310349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9663f-520a-4b80-96a2-f31efb45b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.310934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9663f-520a-4b80-96a2-f31efb45b695 admin admin] PATH_INFO: `/v3/projects/041a7f967107432f807cdce35470e6ca/users/b6ea1cf9ce20483e8e12d1255de357fd/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.338633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9663f-520a-4b80-96a2-f31efb45b695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041a7f967107432f807cdce35470e6ca, user_id=b6ea1cf9ce20483e8e12d1255de357fd, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:38.342067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9663f-520a-4b80-96a2-f31efb45b695 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:38.360231 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1298/2577] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:38 2022] PUT /identity/v3/projects/041a7f967107432f807cdce35470e6ca/users/b6ea1cf9ce20483e8e12d1255de357fd/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:42:38.379856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87e7d1-19b9-4bee-8c54-ddd009788b22 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.380286 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87e7d1-19b9-4bee-8c54-ddd009788b22 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.380601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87e7d1-19b9-4bee-8c54-ddd009788b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.414741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2e87e7d1-19b9-4bee-8c54-ddd009788b22 None None] MFA Rules not processed for user `b6ea1cf9ce20483e8e12d1255de357fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:38.416129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2e87e7d1-19b9-4bee-8c54-ddd009788b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:38.498461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1280/2578] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:38.511972 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9663f-520a-4b80-96a2-f31efb45b695 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:38.513980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f5d9663f-520a-4b80-96a2-f31efb45b695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:38.574002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:38.593752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9663f-520a-4b80-96a2-f31efb45b695 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:38.599343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfbc74-75b5-4824-9ddb-61c55e72330c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:38.600503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfbc74-75b5-4824-9ddb-61c55e72330c service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.601041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfbc74-75b5-4824-9ddb-61c55e72330c service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.601578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfbc74-75b5-4824-9ddb-61c55e72330c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.618271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfbc74-75b5-4824-9ddb-61c55e72330c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:38.621311 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfbc74-75b5-4824-9ddb-61c55e72330c service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:38.639051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1299/2579] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:42:46.884183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87e7d1-19b9-4bee-8c54-ddd009788b22 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:46.886554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2e87e7d1-19b9-4bee-8c54-ddd009788b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:46.916178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87e7d1-19b9-4bee-8c54-ddd009788b22 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:46.923886 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:46.924850 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:46.925469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:46.925680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:46.929034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:47.072301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:47.075184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:47.095416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1281/2580] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:47.279437 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0acb-79c8-427b-bcf3-f39ff743f14c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:47.280478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0acb-79c8-427b-bcf3-f39ff743f14c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:47.280669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0acb-79c8-427b-bcf3-f39ff743f14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:47.323226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ac6a0acb-79c8-427b-bcf3-f39ff743f14c None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:47.326152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ac6a0acb-79c8-427b-bcf3-f39ff743f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:47.454249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1300/2581] 10.222.0.78 () {58 vars in 967 bytes} [Wed Aug 24 03:42:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:47.475455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:47.478354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:47.602685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:47.639243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9686f-a468-4be6-94db-5d535c805c3f service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:47.647461 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98f7b6-d91b-40e7-8914-400c2a864005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:47.648407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98f7b6-d91b-40e7-8914-400c2a864005 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:47.648816 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98f7b6-d91b-40e7-8914-400c2a864005 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:47.649227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98f7b6-d91b-40e7-8914-400c2a864005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:47.663726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98f7b6-d91b-40e7-8914-400c2a864005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:47.667055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98f7b6-d91b-40e7-8914-400c2a864005 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:47.686078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1282/2582] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:42:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:54.429085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a0acb-79c8-427b-bcf3-f39ff743f14c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:54.511385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a0acb-79c8-427b-bcf3-f39ff743f14c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:54.516907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:54.517636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:54.517912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:54.518185 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] PATH_INFO: `/v3/users/b6ea1cf9ce20483e8e12d1255de357fd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:54.519689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ea1cf9ce20483e8e12d1255de357fd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:54.521800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:54.597983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ea1cf9ce20483e8e12d1255de357fd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:54.599040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ea1cf9ce20483e8e12d1255de357fd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:54.617747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ea1cf9ce20483e8e12d1255de357fd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:54.627020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ea1cf9ce20483e8e12d1255de357fd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:54.636023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ea1cf9ce20483e8e12d1255de357fd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:54.644321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1301/2583] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:54 2022] DELETE /identity/v3/users/b6ea1cf9ce20483e8e12d1255de357fd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:54.649573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e754-b666-48a5-8dc6-3d9670083be1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:54.650180 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e754-b666-48a5-8dc6-3d9670083be1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:54.650180 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e754-b666-48a5-8dc6-3d9670083be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:54.673285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-20b5e754-b666-48a5-8dc6-3d9670083be1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:54.674596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-20b5e754-b666-48a5-8dc6-3d9670083be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:54.749470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1283/2584] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:54.761335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:54.763080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:54.777468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:54.840752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62a2a2-b12f-442e-bb1f-56c01244ed4b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:54.845629 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac6468-4f70-46f3-a88d-d547b00df616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:54.846310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac6468-4f70-46f3-a88d-d547b00df616 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:54.846630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac6468-4f70-46f3-a88d-d547b00df616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:54.847363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac6468-4f70-46f3-a88d-d547b00df616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:54.861539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac6468-4f70-46f3-a88d-d547b00df616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:54.863218 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac6468-4f70-46f3-a88d-d547b00df616 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:54.876266 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1302/2585] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:55.237447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e754-b666-48a5-8dc6-3d9670083be1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:55.239948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-20b5e754-b666-48a5-8dc6-3d9670083be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:55.261176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e754-b666-48a5-8dc6-3d9670083be1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:55.267449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:55.268160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:55.268425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:55.268699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] PATH_INFO: `/v3/projects/041a7f967107432f807cdce35470e6ca` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:55.269948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041a7f967107432f807cdce35470e6ca)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:55.272298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:55.355780 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041a7f967107432f807cdce35470e6ca', 'request_id': 'req-85fcc0a0-aebc-4af9-b4f2-74128f349da7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:55.363564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041a7f967107432f807cdce35470e6ca', 'request_id': 'req-85fcc0a0-aebc-4af9-b4f2-74128f349da7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:55.370504 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041a7f967107432f807cdce35470e6ca', 'request_id': 'req-85fcc0a0-aebc-4af9-b4f2-74128f349da7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:55.391965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] The token cache is being invalidate because project 041a7f967107432f807cdce35470e6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:55.392438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:55.393618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-85fcc0a0-aebc-4af9-b4f2-74128f349da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:55.396358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1284/2586] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:55 2022] DELETE /identity/v3/projects/041a7f967107432f807cdce35470e6ca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:55.405763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c972ef-ff87-4007-ae0a-3f801c4d8c42 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:55.406226 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c972ef-ff87-4007-ae0a-3f801c4d8c42 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:55.406867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c972ef-ff87-4007-ae0a-3f801c4d8c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:55.439810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c1c972ef-ff87-4007-ae0a-3f801c4d8c42 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:55.442393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c1c972ef-ff87-4007-ae0a-3f801c4d8c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:55.559716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1303/2587] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:55.570917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2640c-ed96-4594-90bb-6ba38197d1d0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:55.571253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2640c-ed96-4594-90bb-6ba38197d1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:55.571498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2640c-ed96-4594-90bb-6ba38197d1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:55.603517 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-acc2640c-ed96-4594-90bb-6ba38197d1d0 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:55.605680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-acc2640c-ed96-4594-90bb-6ba38197d1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:55.628093 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1285/2588] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:55.637399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c972ef-ff87-4007-ae0a-3f801c4d8c42 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:55.650898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c972ef-ff87-4007-ae0a-3f801c4d8c42 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:55.659157 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec728ca-3c1b-48a3-97da-5c9669845b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:55.660830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec728ca-3c1b-48a3-97da-5c9669845b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:55.661520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec728ca-3c1b-48a3-97da-5c9669845b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:55.662581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec728ca-3c1b-48a3-97da-5c9669845b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:55.663871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec728ca-3c1b-48a3-97da-5c9669845b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:42:55.664548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec728ca-3c1b-48a3-97da-5c9669845b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:55.667860 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec728ca-3c1b-48a3-97da-5c9669845b88 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:55.695336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1304/2589] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:42:55.702808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2640c-ed96-4594-90bb-6ba38197d1d0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:55.715569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2640c-ed96-4594-90bb-6ba38197d1d0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:55.722296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ead1c-5bfc-46d8-96f9-7b3c5b545cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:55.722976 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ead1c-5bfc-46d8-96f9-7b3c5b545cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:55.723314 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ead1c-5bfc-46d8-96f9-7b3c5b545cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:55.723562 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ead1c-5bfc-46d8-96f9-7b3c5b545cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:55.724330 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ead1c-5bfc-46d8-96f9-7b3c5b545cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:55.726893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ead1c-5bfc-46d8-96f9-7b3c5b545cfe admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:55.765606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1286/2590] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:55 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:55.770950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec728ca-3c1b-48a3-97da-5c9669845b88 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:55.789318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec728ca-3c1b-48a3-97da-5c9669845b88 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:55.888090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178511ae-9ffc-4643-8640-b94c005d96e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:55.889329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178511ae-9ffc-4643-8640-b94c005d96e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:55.889814 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178511ae-9ffc-4643-8640-b94c005d96e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:55.890284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178511ae-9ffc-4643-8640-b94c005d96e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:55.892086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178511ae-9ffc-4643-8640-b94c005d96e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:55.895512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178511ae-9ffc-4643-8640-b94c005d96e0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:55.929090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1305/2591] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:55 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:55.934501 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ead1c-5bfc-46d8-96f9-7b3c5b545cfe admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:55.948263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ead1c-5bfc-46d8-96f9-7b3c5b545cfe admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:55.955514 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb3b34-ed3b-44b3-b1e0-d62121480212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:55.956583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb3b34-ed3b-44b3-b1e0-d62121480212 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:55.956877 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb3b34-ed3b-44b3-b1e0-d62121480212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:55.957154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb3b34-ed3b-44b3-b1e0-d62121480212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:55.957900 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb3b34-ed3b-44b3-b1e0-d62121480212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:55.959713 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb3b34-ed3b-44b3-b1e0-d62121480212 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:55.973284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1287/2592] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:42:55.978430 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178511ae-9ffc-4643-8640-b94c005d96e0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:55.994054 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178511ae-9ffc-4643-8640-b94c005d96e0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:56.001047 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766f591-c051-41aa-bd6a-78c7762f911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:56.001835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766f591-c051-41aa-bd6a-78c7762f911e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:56.002141 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766f591-c051-41aa-bd6a-78c7762f911e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:56.002440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766f591-c051-41aa-bd6a-78c7762f911e admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:56.003239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766f591-c051-41aa-bd6a-78c7762f911e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:56.005374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766f591-c051-41aa-bd6a-78c7762f911e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:56.019130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1306/2593] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:56.024712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb3b34-ed3b-44b3-b1e0-d62121480212 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:56.048301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb3b34-ed3b-44b3-b1e0-d62121480212 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:56.055854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77995278-3f51-4358-a5f5-9eadb70b6565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:56.056992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77995278-3f51-4358-a5f5-9eadb70b6565 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:56.057364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77995278-3f51-4358-a5f5-9eadb70b6565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:56.057804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77995278-3f51-4358-a5f5-9eadb70b6565 admin admin] PATH_INFO: `/v3/projects/2e33c94a19cf4312a3fc2f0d740b5c44/users/658e7093a4574b84a1d26e5561c73032/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:56.077376 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77995278-3f51-4358-a5f5-9eadb70b6565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e33c94a19cf4312a3fc2f0d740b5c44, user_id=658e7093a4574b84a1d26e5561c73032, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:56.080483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77995278-3f51-4358-a5f5-9eadb70b6565 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:56.083162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:56.103954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1288/2594] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:56 2022] PUT /identity/v3/projects/2e33c94a19cf4312a3fc2f0d740b5c44/users/658e7093a4574b84a1d26e5561c73032/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:56.118089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07377b7-19dd-4437-aae1-d998d6253e80 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:56.118348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07377b7-19dd-4437-aae1-d998d6253e80 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:56.119559 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07377b7-19dd-4437-aae1-d998d6253e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:56.159771 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e07377b7-19dd-4437-aae1-d998d6253e80 None None] MFA Rules not processed for user `658e7093a4574b84a1d26e5561c73032`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:56.161807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e07377b7-19dd-4437-aae1-d998d6253e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:56.169622 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:56.285287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1307/2595] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:42:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:56.300354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77995278-3f51-4358-a5f5-9eadb70b6565 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:56.303687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-77995278-3f51-4358-a5f5-9eadb70b6565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:56.415194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77995278-3f51-4358-a5f5-9eadb70b6565 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:56.420873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601a1c9-bcd7-4361-942d-8e2c059f68d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:56.422024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a1c9-bcd7-4361-942d-8e2c059f68d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:56.422715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a1c9-bcd7-4361-942d-8e2c059f68d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:56.423906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601a1c9-bcd7-4361-942d-8e2c059f68d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:56.446622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601a1c9-bcd7-4361-942d-8e2c059f68d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:56.448380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601a1c9-bcd7-4361-942d-8e2c059f68d0 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:56.461542 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1289/2596] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:00.587922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07377b7-19dd-4437-aae1-d998d6253e80 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:00.714099 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07377b7-19dd-4437-aae1-d998d6253e80 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:00.719147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:00.719883 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:00.720156 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:00.720463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] PATH_INFO: `/v3/users/658e7093a4574b84a1d26e5561c73032` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:00.721894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658e7093a4574b84a1d26e5561c73032)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:00.724331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:00.816215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658e7093a4574b84a1d26e5561c73032'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:00.817411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658e7093a4574b84a1d26e5561c73032'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:00.834417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658e7093a4574b84a1d26e5561c73032'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:00.844840 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658e7093a4574b84a1d26e5561c73032'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:00.854073 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658e7093a4574b84a1d26e5561c73032'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:00.863051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1308/2597] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:00 2022] DELETE /identity/v3/users/658e7093a4574b84a1d26e5561c73032 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:00.868541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f939-7d37-4938-8cab-bee5fa59027a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:00.869511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f939-7d37-4938-8cab-bee5fa59027a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:00.869511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f939-7d37-4938-8cab-bee5fa59027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:00.896327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5047f939-7d37-4938-8cab-bee5fa59027a None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:00.898233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5047f939-7d37-4938-8cab-bee5fa59027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:00.976455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1290/2598] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:00.988427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:00.990921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:01.055193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:01.104697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bcdff-29dc-4633-ac41-96b0eba48a23 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:01.109892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cfc00-8df5-4b5f-a449-482ca42d9a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:01.110850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cfc00-8df5-4b5f-a449-482ca42d9a28 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:01.111235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cfc00-8df5-4b5f-a449-482ca42d9a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:01.111627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cfc00-8df5-4b5f-a449-482ca42d9a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:01.124144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cfc00-8df5-4b5f-a449-482ca42d9a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:01.126531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cfc00-8df5-4b5f-a449-482ca42d9a28 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:01.138907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1309/2599] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:01.562260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047f939-7d37-4938-8cab-bee5fa59027a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:01.564200 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5047f939-7d37-4938-8cab-bee5fa59027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:01.603013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047f939-7d37-4938-8cab-bee5fa59027a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:01.614530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:01.615838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:01.616349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:01.617164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] PATH_INFO: `/v3/projects/2e33c94a19cf4312a3fc2f0d740b5c44` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:01.626254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e33c94a19cf4312a3fc2f0d740b5c44)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:01.628614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:01.757611 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e33c94a19cf4312a3fc2f0d740b5c44', 'request_id': 'req-bdbc4561-7ee9-4458-a07c-68953de0f90f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:01.774500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e33c94a19cf4312a3fc2f0d740b5c44', 'request_id': 'req-bdbc4561-7ee9-4458-a07c-68953de0f90f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:01.791411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e33c94a19cf4312a3fc2f0d740b5c44', 'request_id': 'req-bdbc4561-7ee9-4458-a07c-68953de0f90f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:01.821854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] The token cache is being invalidate because project 2e33c94a19cf4312a3fc2f0d740b5c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:01.822531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:01.824424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bdbc4561-7ee9-4458-a07c-68953de0f90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:01.827927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1291/2600] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:01 2022] DELETE /identity/v3/projects/2e33c94a19cf4312a3fc2f0d740b5c44 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:01.837051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace61a71-9352-47c1-a6ba-20eecb125b0d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:01.837716 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace61a71-9352-47c1-a6ba-20eecb125b0d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:01.837816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace61a71-9352-47c1-a6ba-20eecb125b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:01.882553 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ace61a71-9352-47c1-a6ba-20eecb125b0d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:01.884602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ace61a71-9352-47c1-a6ba-20eecb125b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:02.017388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1310/2601] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:02.029729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a02c7-651a-400f-b01b-1c0006732e7d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.030573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a02c7-651a-400f-b01b-1c0006732e7d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.031003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a02c7-651a-400f-b01b-1c0006732e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.070365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-828a02c7-651a-400f-b01b-1c0006732e7d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:02.072682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-828a02c7-651a-400f-b01b-1c0006732e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:02.091619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1292/2602] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:02.098805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace61a71-9352-47c1-a6ba-20eecb125b0d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:02.117839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace61a71-9352-47c1-a6ba-20eecb125b0d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:02.127002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e2a9b-579c-4561-8dd7-aadc160e47cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:02.128148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2a9b-579c-4561-8dd7-aadc160e47cc admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.128641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2a9b-579c-4561-8dd7-aadc160e47cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.129104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2a9b-579c-4561-8dd7-aadc160e47cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.130601 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e2a9b-579c-4561-8dd7-aadc160e47cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:43:02.131160 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e2a9b-579c-4561-8dd7-aadc160e47cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:02.134279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e2a9b-579c-4561-8dd7-aadc160e47cc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:02.158854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1311/2603] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:43:02.164011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a02c7-651a-400f-b01b-1c0006732e7d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:02.175107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a02c7-651a-400f-b01b-1c0006732e7d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:02.181190 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2d8d1-89a1-4800-80a9-9aaa9bf2f687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:02.181892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d8d1-89a1-4800-80a9-9aaa9bf2f687 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.182099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d8d1-89a1-4800-80a9-9aaa9bf2f687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.182374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d8d1-89a1-4800-80a9-9aaa9bf2f687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.183098 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2d8d1-89a1-4800-80a9-9aaa9bf2f687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:02.185110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2d8d1-89a1-4800-80a9-9aaa9bf2f687 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:02.203024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:02.233382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1293/2604] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:02 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:02.239269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e2a9b-579c-4561-8dd7-aadc160e47cc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:02.253069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e2a9b-579c-4561-8dd7-aadc160e47cc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:02.333341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52510b-05b8-457b-b313-6481a0969611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:02.334108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52510b-05b8-457b-b313-6481a0969611 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.334385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52510b-05b8-457b-b313-6481a0969611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.334677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52510b-05b8-457b-b313-6481a0969611 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.335434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52510b-05b8-457b-b313-6481a0969611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:02.337726 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52510b-05b8-457b-b313-6481a0969611 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:02.373087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1312/2605] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:02 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:02.378723 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2d8d1-89a1-4800-80a9-9aaa9bf2f687 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:02.392090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2d8d1-89a1-4800-80a9-9aaa9bf2f687 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:02.398242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7d2eb-7582-4155-bcb6-7d5e03002525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:02.399070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d2eb-7582-4155-bcb6-7d5e03002525 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.399381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d2eb-7582-4155-bcb6-7d5e03002525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.399730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d2eb-7582-4155-bcb6-7d5e03002525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.400515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7d2eb-7582-4155-bcb6-7d5e03002525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:02.402522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7d2eb-7582-4155-bcb6-7d5e03002525 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:02.417423 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1294/2606] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:02.422790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52510b-05b8-457b-b313-6481a0969611 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:02.436454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52510b-05b8-457b-b313-6481a0969611 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:02.442178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7fb9b-122c-40e8-81b6-e80e159aa070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:02.443555 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7fb9b-122c-40e8-81b6-e80e159aa070 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.444005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7fb9b-122c-40e8-81b6-e80e159aa070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.444402 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7fb9b-122c-40e8-81b6-e80e159aa070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.445280 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7fb9b-122c-40e8-81b6-e80e159aa070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:02.447179 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7fb9b-122c-40e8-81b6-e80e159aa070 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:02.461670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1313/2607] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:02.466672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7d2eb-7582-4155-bcb6-7d5e03002525 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:02.484948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7d2eb-7582-4155-bcb6-7d5e03002525 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:02.491285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10e625-2dbd-4d41-9a61-6264d8f3abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:02.491993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10e625-2dbd-4d41-9a61-6264d8f3abae admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.492572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10e625-2dbd-4d41-9a61-6264d8f3abae admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.492572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10e625-2dbd-4d41-9a61-6264d8f3abae admin admin] PATH_INFO: `/v3/projects/8b04571018884e69818428e67d95c53a/users/a262480df91a493f9c49849eb47bafe0/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.511736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10e625-2dbd-4d41-9a61-6264d8f3abae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b04571018884e69818428e67d95c53a, user_id=a262480df91a493f9c49849eb47bafe0, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:02.514702 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10e625-2dbd-4d41-9a61-6264d8f3abae admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:02.531978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1295/2608] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:02 2022] PUT /identity/v3/projects/8b04571018884e69818428e67d95c53a/users/a262480df91a493f9c49849eb47bafe0/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:43:02.544298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63de0c-f440-4832-8fc6-11fd3b43f7cb None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.544777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63de0c-f440-4832-8fc6-11fd3b43f7cb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.544777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63de0c-f440-4832-8fc6-11fd3b43f7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.578040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6a63de0c-f440-4832-8fc6-11fd3b43f7cb None None] MFA Rules not processed for user `a262480df91a493f9c49849eb47bafe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:02.579326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6a63de0c-f440-4832-8fc6-11fd3b43f7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:02.613672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:02.706867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1314/2609] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:02.712501 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10e625-2dbd-4d41-9a61-6264d8f3abae admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:02.799027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10e625-2dbd-4d41-9a61-6264d8f3abae admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:02.805167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90bfd-fd63-436a-ae35-fb3630ee6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:02.805873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90bfd-fd63-436a-ae35-fb3630ee6201 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.806191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90bfd-fd63-436a-ae35-fb3630ee6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.806629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90bfd-fd63-436a-ae35-fb3630ee6201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.807393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90bfd-fd63-436a-ae35-fb3630ee6201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:02.809796 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90bfd-fd63-436a-ae35-fb3630ee6201 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:02.849319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1296/2610] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:02 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:02.855016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63de0c-f440-4832-8fc6-11fd3b43f7cb None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:02.872012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63de0c-f440-4832-8fc6-11fd3b43f7cb None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:02.954554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2399ec-d084-4ad2-be6c-63f5a5254c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:02.955627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2399ec-d084-4ad2-be6c-63f5a5254c0c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:02.956118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2399ec-d084-4ad2-be6c-63f5a5254c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:02.956591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2399ec-d084-4ad2-be6c-63f5a5254c0c admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:02.957772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2399ec-d084-4ad2-be6c-63f5a5254c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:02.961529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2399ec-d084-4ad2-be6c-63f5a5254c0c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:02.993399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1315/2611] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:02 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:02.998438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90bfd-fd63-436a-ae35-fb3630ee6201 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:03.012092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90bfd-fd63-436a-ae35-fb3630ee6201 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:03.020250 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda66ad-5b17-4451-963c-798b96300935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:03.021598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda66ad-5b17-4451-963c-798b96300935 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:03.022096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda66ad-5b17-4451-963c-798b96300935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:03.022698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda66ad-5b17-4451-963c-798b96300935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:03.023908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda66ad-5b17-4451-963c-798b96300935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:03.027062 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda66ad-5b17-4451-963c-798b96300935 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:03.047565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1297/2612] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:03.055245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2399ec-d084-4ad2-be6c-63f5a5254c0c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:03.075931 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2399ec-d084-4ad2-be6c-63f5a5254c0c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:03.084816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b46370-abc8-4dd8-8f4e-870c6b7fbde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:03.085856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46370-abc8-4dd8-8f4e-870c6b7fbde9 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:03.086338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46370-abc8-4dd8-8f4e-870c6b7fbde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:03.086981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46370-abc8-4dd8-8f4e-870c6b7fbde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:03.088065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b46370-abc8-4dd8-8f4e-870c6b7fbde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:03.091293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b46370-abc8-4dd8-8f4e-870c6b7fbde9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:03.115702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1316/2613] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:03.122726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda66ad-5b17-4451-963c-798b96300935 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:03.143178 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda66ad-5b17-4451-963c-798b96300935 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:03.152777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb8ff-31aa-4321-bada-4935aa7ba37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:03.160908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb8ff-31aa-4321-bada-4935aa7ba37b admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:03.160908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb8ff-31aa-4321-bada-4935aa7ba37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:03.160908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb8ff-31aa-4321-bada-4935aa7ba37b admin admin] PATH_INFO: `/v3/projects/bc2200f65c5d41d9932ebce583ddaa00/users/61d6c0fce2c1453cb4d8e7216b72c7a2/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:03.198225 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecb8ff-31aa-4321-bada-4935aa7ba37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2200f65c5d41d9932ebce583ddaa00, user_id=61d6c0fce2c1453cb4d8e7216b72c7a2, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:03.204186 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecb8ff-31aa-4321-bada-4935aa7ba37b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:03.229759 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1298/2614] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:03 2022] PUT /identity/v3/projects/bc2200f65c5d41d9932ebce583ddaa00/users/61d6c0fce2c1453cb4d8e7216b72c7a2/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:03.243417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840fa9f-ef2c-4367-a106-821bef2f8968 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:03.243915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840fa9f-ef2c-4367-a106-821bef2f8968 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:03.244375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840fa9f-ef2c-4367-a106-821bef2f8968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:03.306249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b840fa9f-ef2c-4367-a106-821bef2f8968 None None] MFA Rules not processed for user `61d6c0fce2c1453cb4d8e7216b72c7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:03.309056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b840fa9f-ef2c-4367-a106-821bef2f8968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:03.428960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1317/2615] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:03.433219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb8ff-31aa-4321-bada-4935aa7ba37b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:03.553041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb8ff-31aa-4321-bada-4935aa7ba37b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:03.561596 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee619754-f16f-42da-b7e7-2072acd8b349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:03.562274 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee619754-f16f-42da-b7e7-2072acd8b349 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:03.562563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee619754-f16f-42da-b7e7-2072acd8b349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:03.562884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee619754-f16f-42da-b7e7-2072acd8b349 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:03.563587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee619754-f16f-42da-b7e7-2072acd8b349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:03.565847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee619754-f16f-42da-b7e7-2072acd8b349 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:03.580011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:03.613887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1299/2616] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:03 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:03.615759 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840fa9f-ef2c-4367-a106-821bef2f8968 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:03.632120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840fa9f-ef2c-4367-a106-821bef2f8968 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:03.667898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:03.704915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dd6b5-a55e-4cab-b4e8-01ec2446d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:03.705604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dd6b5-a55e-4cab-b4e8-01ec2446d8ac admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:03.705884 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dd6b5-a55e-4cab-b4e8-01ec2446d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:03.706125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dd6b5-a55e-4cab-b4e8-01ec2446d8ac admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:03.706958 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dd6b5-a55e-4cab-b4e8-01ec2446d8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:03.708985 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dd6b5-a55e-4cab-b4e8-01ec2446d8ac admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:03.736586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1318/2617] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:03 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:03.743179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee619754-f16f-42da-b7e7-2072acd8b349 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:03.761620 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee619754-f16f-42da-b7e7-2072acd8b349 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:03.768694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21f8e4-abfd-44a6-ac8a-db78a0e87b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:03.769970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21f8e4-abfd-44a6-ac8a-db78a0e87b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:03.770556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21f8e4-abfd-44a6-ac8a-db78a0e87b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:03.770939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21f8e4-abfd-44a6-ac8a-db78a0e87b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:03.771687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21f8e4-abfd-44a6-ac8a-db78a0e87b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:03.773499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21f8e4-abfd-44a6-ac8a-db78a0e87b49 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:03.787494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1300/2618] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:03.792733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dd6b5-a55e-4cab-b4e8-01ec2446d8ac admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:03.804105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dd6b5-a55e-4cab-b4e8-01ec2446d8ac admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:03.811221 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e182-55c9-403b-9c05-913294e1b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:03.811943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e182-55c9-403b-9c05-913294e1b911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:03.812283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e182-55c9-403b-9c05-913294e1b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:03.812547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e182-55c9-403b-9c05-913294e1b911 admin admin] PATH_INFO: `/v3/projects/786396d49ef64b8a8d9f132f5697060f/users/a5c20031777d446fa46cefabebc89a7f/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:03.835995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1e182-55c9-403b-9c05-913294e1b911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786396d49ef64b8a8d9f132f5697060f, user_id=a5c20031777d446fa46cefabebc89a7f, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:03.841039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1e182-55c9-403b-9c05-913294e1b911 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:03.862566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1319/2619] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:03 2022] PUT /identity/v3/projects/786396d49ef64b8a8d9f132f5697060f/users/a5c20031777d446fa46cefabebc89a7f/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:03.868131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21f8e4-abfd-44a6-ac8a-db78a0e87b49 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:03.883213 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21f8e4-abfd-44a6-ac8a-db78a0e87b49 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:03.957599 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c1939-3b81-40a0-a5aa-cdc42e3bafd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:03.958241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c1939-3b81-40a0-a5aa-cdc42e3bafd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:03.958515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c1939-3b81-40a0-a5aa-cdc42e3bafd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:03.958824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c1939-3b81-40a0-a5aa-cdc42e3bafd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:03.959492 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c1939-3b81-40a0-a5aa-cdc42e3bafd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:03.961171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c1939-3b81-40a0-a5aa-cdc42e3bafd6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:03.978808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1301/2620] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:03.985316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e182-55c9-403b-9c05-913294e1b911 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:04.001788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e182-55c9-403b-9c05-913294e1b911 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:04.007019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede078a3-5b6c-446d-a695-4516529c816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:04.007717 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede078a3-5b6c-446d-a695-4516529c816a admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:04.007990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede078a3-5b6c-446d-a695-4516529c816a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:04.008473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede078a3-5b6c-446d-a695-4516529c816a admin admin] PATH_INFO: `/v3/projects/786396d49ef64b8a8d9f132f5697060f/users/a5c20031777d446fa46cefabebc89a7f/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:04.016611 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede078a3-5b6c-446d-a695-4516529c816a admin admin] RBAC: Authorizing `identity:create_grant(project_id=786396d49ef64b8a8d9f132f5697060f, user_id=a5c20031777d446fa46cefabebc89a7f, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:04.019482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede078a3-5b6c-446d-a695-4516529c816a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:04.034244 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1320/2621] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:03 2022] PUT /identity/v3/projects/786396d49ef64b8a8d9f132f5697060f/users/a5c20031777d446fa46cefabebc89a7f/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:04.053881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c611529-7be1-43d3-af75-a1f3fbe61c38 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:04.054537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c611529-7be1-43d3-af75-a1f3fbe61c38 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:04.055235 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c611529-7be1-43d3-af75-a1f3fbe61c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:04.106986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1c611529-7be1-43d3-af75-a1f3fbe61c38 None None] MFA Rules not processed for user `a5c20031777d446fa46cefabebc89a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:04.108614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1c611529-7be1-43d3-af75-a1f3fbe61c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:04.209590 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1302/2622] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:04.228000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede078a3-5b6c-446d-a695-4516529c816a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:04.230696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ede078a3-5b6c-446d-a695-4516529c816a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:04.309711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede078a3-5b6c-446d-a695-4516529c816a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:04.316183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca739b-46a2-41f9-a739-123526220e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:04.317257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca739b-46a2-41f9-a739-123526220e88 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:04.317828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca739b-46a2-41f9-a739-123526220e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:04.318608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca739b-46a2-41f9-a739-123526220e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:04.403093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca739b-46a2-41f9-a739-123526220e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:04.405788 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca739b-46a2-41f9-a739-123526220e88 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:04.423848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1321/2623] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:04.707333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c611529-7be1-43d3-af75-a1f3fbe61c38 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:04.711426 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1c611529-7be1-43d3-af75-a1f3fbe61c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:04.817281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c611529-7be1-43d3-af75-a1f3fbe61c38 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:04.824204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474f8d-1ddd-4bd9-b90d-d8b3ee822ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:04.825453 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474f8d-1ddd-4bd9-b90d-d8b3ee822ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:04.826011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474f8d-1ddd-4bd9-b90d-d8b3ee822ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:04.826470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474f8d-1ddd-4bd9-b90d-d8b3ee822ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:04.829719 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e5474f8d-1ddd-4bd9-b90d-d8b3ee822ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:04.855716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:04.949141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5474f8d-1ddd-4bd9-b90d-d8b3ee822ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:04.951835 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5474f8d-1ddd-4bd9-b90d-d8b3ee822ad8 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:04.967915 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1303/2624] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:06.418925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca739b-46a2-41f9-a739-123526220e88 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:06.420930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0eca739b-46a2-41f9-a739-123526220e88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:06.441686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca739b-46a2-41f9-a739-123526220e88 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:06.447518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0dddc-cbba-4643-b427-71f10964ed85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:06.450055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0dddc-cbba-4643-b427-71f10964ed85 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:06.450374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0dddc-cbba-4643-b427-71f10964ed85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:06.450597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0dddc-cbba-4643-b427-71f10964ed85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:06.541339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:06.584738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0dddc-cbba-4643-b427-71f10964ed85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:06.588390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0dddc-cbba-4643-b427-71f10964ed85 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:06.609293 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1322/2625] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:07.462707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474f8d-1ddd-4bd9-b90d-d8b3ee822ad8 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:07.480149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474f8d-1ddd-4bd9-b90d-d8b3ee822ad8 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:07.487712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7a05-b0f6-464c-8aef-b4687936a8bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:07.488851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7a05-b0f6-464c-8aef-b4687936a8bb service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:07.489266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7a05-b0f6-464c-8aef-b4687936a8bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:07.489729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7a05-b0f6-464c-8aef-b4687936a8bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:07.508165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7a05-b0f6-464c-8aef-b4687936a8bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:07.511953 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7a05-b0f6-464c-8aef-b4687936a8bb service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:07.533111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1304/2626] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:43:10.099064 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0dddc-cbba-4643-b427-71f10964ed85 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:10.101267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f5a0dddc-cbba-4643-b427-71f10964ed85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:10.129836 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0dddc-cbba-4643-b427-71f10964ed85 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:10.135233 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:10.135962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:10.136236 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:10.136505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] PATH_INFO: `/v3/users/f447a34300944a5da25f6408f802f602` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:10.157696 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f447a34300944a5da25f6408f802f602)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:10.159852 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:10.235878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f447a34300944a5da25f6408f802f602'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.237148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f447a34300944a5da25f6408f802f602'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.261646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f447a34300944a5da25f6408f802f602'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.278563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f447a34300944a5da25f6408f802f602'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.293364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-41f8ec56-9568-4418-9e82-56486510c91b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f447a34300944a5da25f6408f802f602'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.306416 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1323/2627] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:10 2022] DELETE /identity/v3/users/f447a34300944a5da25f6408f802f602 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:10.615248 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7a05-b0f6-464c-8aef-b4687936a8bb service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:10.638339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7a05-b0f6-464c-8aef-b4687936a8bb service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:10.752167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:10.753031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:10.753388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:10.753720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] PATH_INFO: `/v3/projects/3989b5dc1ded4718af973b4e794ff1be` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:10.770581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3989b5dc1ded4718af973b4e794ff1be)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:10.772863 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:10.859672 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3989b5dc1ded4718af973b4e794ff1be', 'request_id': 'req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.871956 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3989b5dc1ded4718af973b4e794ff1be', 'request_id': 'req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.884467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3989b5dc1ded4718af973b4e794ff1be', 'request_id': 'req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.913339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] The token cache is being invalidate because project 3989b5dc1ded4718af973b4e794ff1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:10.917183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.917183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-650b9cd9-56f1-4b9f-b8c1-5a133fe36d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:10.920257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1305/2628] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:10 2022] DELETE /identity/v3/projects/3989b5dc1ded4718af973b4e794ff1be => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:10.929019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1de325-4518-48c2-b9d9-a2401f7b6cd5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:10.930002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1de325-4518-48c2-b9d9-a2401f7b6cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:10.930452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1de325-4518-48c2-b9d9-a2401f7b6cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:10.971527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0e1de325-4518-48c2-b9d9-a2401f7b6cd5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:10.974534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0e1de325-4518-48c2-b9d9-a2401f7b6cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:11.111805 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1324/2629] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:11.132406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36bf1e-aebf-415e-aec9-e5dccbcf2682 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:11.132845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36bf1e-aebf-415e-aec9-e5dccbcf2682 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:11.132992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36bf1e-aebf-415e-aec9-e5dccbcf2682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:11.211503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fe36bf1e-aebf-415e-aec9-e5dccbcf2682 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:11.214740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fe36bf1e-aebf-415e-aec9-e5dccbcf2682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:11.237053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1306/2630] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:11.245432 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1de325-4518-48c2-b9d9-a2401f7b6cd5 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:11.270628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1de325-4518-48c2-b9d9-a2401f7b6cd5 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:11.280241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e80d1-5e66-4885-949c-74bc5502215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:11.281967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e80d1-5e66-4885-949c-74bc5502215a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:11.282856 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e80d1-5e66-4885-949c-74bc5502215a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:11.283533 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e80d1-5e66-4885-949c-74bc5502215a admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:11.285118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e80d1-5e66-4885-949c-74bc5502215a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:43:11.296381 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e80d1-5e66-4885-949c-74bc5502215a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:11.300577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e80d1-5e66-4885-949c-74bc5502215a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:11.338734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1325/2631] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:43:11.341556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36bf1e-aebf-415e-aec9-e5dccbcf2682 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:11.368365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36bf1e-aebf-415e-aec9-e5dccbcf2682 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:11.378192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372b34d-24ce-45bd-8e82-46987e529e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:11.379431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b34d-24ce-45bd-8e82-46987e529e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:11.380297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b34d-24ce-45bd-8e82-46987e529e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:11.381028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b34d-24ce-45bd-8e82-46987e529e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:11.382858 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372b34d-24ce-45bd-8e82-46987e529e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:11.387447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372b34d-24ce-45bd-8e82-46987e529e87 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:11.416919 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:11.460352 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1307/2632] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:11 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:11.462131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e80d1-5e66-4885-949c-74bc5502215a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:11.476120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e80d1-5e66-4885-949c-74bc5502215a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:11.529247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:11.585705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33448f-13cf-4308-a158-f273ab158ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:11.586359 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33448f-13cf-4308-a158-f273ab158ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:11.586676 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33448f-13cf-4308-a158-f273ab158ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:11.586917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33448f-13cf-4308-a158-f273ab158ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:11.587701 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33448f-13cf-4308-a158-f273ab158ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:11.589754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33448f-13cf-4308-a158-f273ab158ddc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:11.627780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1326/2633] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:11 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:11.632934 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372b34d-24ce-45bd-8e82-46987e529e87 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:11.647581 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372b34d-24ce-45bd-8e82-46987e529e87 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:11.652992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c9db-09e4-4d20-b5f1-9f68a05e4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:11.653827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c9db-09e4-4d20-b5f1-9f68a05e4c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:11.654212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c9db-09e4-4d20-b5f1-9f68a05e4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:11.654796 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c9db-09e4-4d20-b5f1-9f68a05e4c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:11.655754 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778c9db-09e4-4d20-b5f1-9f68a05e4c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:11.657895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778c9db-09e4-4d20-b5f1-9f68a05e4c0c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:11.669887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1308/2634] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:11.674952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33448f-13cf-4308-a158-f273ab158ddc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:11.689016 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33448f-13cf-4308-a158-f273ab158ddc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:11.697281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe5d8c-1ab5-44ea-8975-2c0efda02574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:11.698326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe5d8c-1ab5-44ea-8975-2c0efda02574 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:11.698904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe5d8c-1ab5-44ea-8975-2c0efda02574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:11.699385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe5d8c-1ab5-44ea-8975-2c0efda02574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:11.700811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe5d8c-1ab5-44ea-8975-2c0efda02574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:11.704385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe5d8c-1ab5-44ea-8975-2c0efda02574 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:11.725060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1327/2635] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:11.729825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c9db-09e4-4d20-b5f1-9f68a05e4c0c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:11.742167 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c9db-09e4-4d20-b5f1-9f68a05e4c0c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:11.747588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6126908-b3e4-433b-aa72-6d907fad9f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:11.748290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6126908-b3e4-433b-aa72-6d907fad9f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:11.748565 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6126908-b3e4-433b-aa72-6d907fad9f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:11.748838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6126908-b3e4-433b-aa72-6d907fad9f5f admin admin] PATH_INFO: `/v3/projects/b2b9eee381cc49c0bcf17594971db843/users/b80312de00e74d7fa16ea604c06f8f1b/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:11.767043 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6126908-b3e4-433b-aa72-6d907fad9f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b9eee381cc49c0bcf17594971db843, user_id=b80312de00e74d7fa16ea604c06f8f1b, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:11.769805 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6126908-b3e4-433b-aa72-6d907fad9f5f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:11.787572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1309/2636] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:11 2022] PUT /identity/v3/projects/b2b9eee381cc49c0bcf17594971db843/users/b80312de00e74d7fa16ea604c06f8f1b/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:11.798591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d10315-a1be-41cb-a4ed-a837c0d381d3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:11.799015 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d10315-a1be-41cb-a4ed-a837c0d381d3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:11.799303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d10315-a1be-41cb-a4ed-a837c0d381d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:11.843345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-99d10315-a1be-41cb-a4ed-a837c0d381d3 None None] MFA Rules not processed for user `b80312de00e74d7fa16ea604c06f8f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:11.844857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-99d10315-a1be-41cb-a4ed-a837c0d381d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:11.861421 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6126908-b3e4-433b-aa72-6d907fad9f5f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:11.864203 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e6126908-b3e4-433b-aa72-6d907fad9f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:11.978859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1328/2637] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:11.986799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d10315-a1be-41cb-a4ed-a837c0d381d3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:11.989641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-99d10315-a1be-41cb-a4ed-a837c0d381d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:11.998375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6126908-b3e4-433b-aa72-6d907fad9f5f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:12.006714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:12.007364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:12.007651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:12.007925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:12.009936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:12.031123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:12.035604 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:12.055013 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1310/2638] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:43:12.128524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d10315-a1be-41cb-a4ed-a837c0d381d3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:12.135336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1391c6d-a6ca-4dc5-bfa1-64bf58213c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:12.136010 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1391c6d-a6ca-4dc5-bfa1-64bf58213c4a service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:12.136287 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1391c6d-a6ca-4dc5-bfa1-64bf58213c4a service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:12.136585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1391c6d-a6ca-4dc5-bfa1-64bf58213c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:12.146728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1391c6d-a6ca-4dc5-bfa1-64bf58213c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:12.148388 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1391c6d-a6ca-4dc5-bfa1-64bf58213c4a service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:12.160420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1329/2639] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:12.346021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:12.346021 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:12.509616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978eabe-1f23-42f9-a1df-769a40c60fa8 service placement] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:12.516318 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:12.517984 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:12.518374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:12.518869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] PATH_INFO: `/v3/users/a262480df91a493f9c49849eb47bafe0` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:12.520795 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a262480df91a493f9c49849eb47bafe0)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:12.523448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:12.576315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1391c6d-a6ca-4dc5-bfa1-64bf58213c4a service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:12.592807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1391c6d-a6ca-4dc5-bfa1-64bf58213c4a service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:12.601780 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:12.602700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a262480df91a493f9c49849eb47bafe0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.602978 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:12.603453 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:12.603626 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a262480df91a493f9c49849eb47bafe0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.603927 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] PATH_INFO: `/v3/users/b80312de00e74d7fa16ea604c06f8f1b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:12.604362 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a262480df91a493f9c49849eb47bafe0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.606147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80312de00e74d7fa16ea604c06f8f1b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:12.606706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:12.611737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:12.642586 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:12.645569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a262480df91a493f9c49849eb47bafe0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.662778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-53834d1d-a541-4bc2-8b94-ff7958d3f7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a262480df91a493f9c49849eb47bafe0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.691168 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1311/2640] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:12 2022] DELETE /identity/v3/users/a262480df91a493f9c49849eb47bafe0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:12.697212 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479bd45-9d8d-4808-96db-e26c2732e634 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:12.698342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479bd45-9d8d-4808-96db-e26c2732e634 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:12.698893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479bd45-9d8d-4808-96db-e26c2732e634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:12.719395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80312de00e74d7fa16ea604c06f8f1b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.720468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80312de00e74d7fa16ea604c06f8f1b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.727781 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1479bd45-9d8d-4808-96db-e26c2732e634 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:12.730798 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1479bd45-9d8d-4808-96db-e26c2732e634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:12.744086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80312de00e74d7fa16ea604c06f8f1b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.758645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80312de00e74d7fa16ea604c06f8f1b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.773563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5d45c8bb-8d19-4706-8b7b-eb319715708a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80312de00e74d7fa16ea604c06f8f1b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:12.786367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1330/2641] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:12 2022] DELETE /identity/v3/users/b80312de00e74d7fa16ea604c06f8f1b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:12.792392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e72d3-634c-4f03-b547-172fea113148 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:12.792950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e72d3-634c-4f03-b547-172fea113148 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:12.793431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e72d3-634c-4f03-b547-172fea113148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:12.829923 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a73e72d3-634c-4f03-b547-172fea113148 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:12.831334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a73e72d3-634c-4f03-b547-172fea113148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:12.834054 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1312/2642] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:12.847459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479bd45-9d8d-4808-96db-e26c2732e634 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:12.849499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1479bd45-9d8d-4808-96db-e26c2732e634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:12.927092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1331/2643] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:12.937166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479bd45-9d8d-4808-96db-e26c2732e634 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:12.937686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e72d3-634c-4f03-b547-172fea113148 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:13.012173 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc0320-de64-4235-830e-ca05da85879a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:13.012921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc0320-de64-4235-830e-ca05da85879a service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:13.013462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc0320-de64-4235-830e-ca05da85879a service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:13.013834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc0320-de64-4235-830e-ca05da85879a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:13.024828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e72d3-634c-4f03-b547-172fea113148 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:13.030359 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195304c-0579-4654-a846-f242c179b9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:13.032164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195304c-0579-4654-a846-f242c179b9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:13.032361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc0320-de64-4235-830e-ca05da85879a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:13.032541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195304c-0579-4654-a846-f242c179b9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:13.032709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195304c-0579-4654-a846-f242c179b9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:13.035537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc0320-de64-4235-830e-ca05da85879a service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:13.044786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195304c-0579-4654-a846-f242c179b9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:13.048442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195304c-0579-4654-a846-f242c179b9d7 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:13.053441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1313/2644] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:43:13.062598 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc0320-de64-4235-830e-ca05da85879a service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:13.067290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-61dc0320-de64-4235-830e-ca05da85879a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:13.075631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1332/2645] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:43:13.094211 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc0320-de64-4235-830e-ca05da85879a service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:13.102450 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:13.103618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:13.104131 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:13.104614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] PATH_INFO: `/v3/users/01a1bb68c2294c6fb7806abf7349bd56` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:13.107057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a1bb68c2294c6fb7806abf7349bd56)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:13.111295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:13.150248 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:13.201447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a1bb68c2294c6fb7806abf7349bd56'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.202463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a1bb68c2294c6fb7806abf7349bd56'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.203296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a1bb68c2294c6fb7806abf7349bd56'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.232468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a1bb68c2294c6fb7806abf7349bd56'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.246933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a1bb68c2294c6fb7806abf7349bd56'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.269732 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1314/2646] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:13 2022] DELETE /identity/v3/users/01a1bb68c2294c6fb7806abf7349bd56 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:13.548292 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195304c-0579-4654-a846-f242c179b9d7 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:13.551139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6195304c-0579-4654-a846-f242c179b9d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:13.576037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195304c-0579-4654-a846-f242c179b9d7 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:13.622520 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:13.662269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:13.663393 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:13.663865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:13.664335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] PATH_INFO: `/v3/projects/b2b9eee381cc49c0bcf17594971db843` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:13.666499 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b9eee381cc49c0bcf17594971db843)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:13.670281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:13.775065 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b9eee381cc49c0bcf17594971db843', 'request_id': 'req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.777478 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:13.780862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:13.792655 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b9eee381cc49c0bcf17594971db843', 'request_id': 'req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.803955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b9eee381cc49c0bcf17594971db843', 'request_id': 'req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.825746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] The token cache is being invalidate because project b2b9eee381cc49c0bcf17594971db843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:13.826087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.826802 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:13.828467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21582bd5-c39f-4141-82ba-a5fbeddd6430 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:13.832565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1333/2647] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:13 2022] DELETE /identity/v3/projects/b2b9eee381cc49c0bcf17594971db843 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:13.832565 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:13.833545 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:13.918331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65255cb-bfd9-467f-a7a4-3c448b63c3f7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:13.923827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:13.924623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:13.924899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:13.925173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] PATH_INFO: `/v3/projects/8b04571018884e69818428e67d95c53a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:13.926405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b04571018884e69818428e67d95c53a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:13.928504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:13.929179 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:13.930588 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:13.931144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:13.931996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] PATH_INFO: `/v3/projects/097359f0dcfd4d289f56c08aaa025fad` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:13.933724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=097359f0dcfd4d289f56c08aaa025fad)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:13.939288 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:13.993493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b04571018884e69818428e67d95c53a', 'request_id': 'req-1aff26f5-df98-48b8-9999-f29cc781383f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.003613 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b04571018884e69818428e67d95c53a', 'request_id': 'req-1aff26f5-df98-48b8-9999-f29cc781383f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.011434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b04571018884e69818428e67d95c53a', 'request_id': 'req-1aff26f5-df98-48b8-9999-f29cc781383f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.015910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097359f0dcfd4d289f56c08aaa025fad', 'request_id': 'req-92c4fcc0-6111-4264-9d42-0b98e711f7cd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.017310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:14.023477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097359f0dcfd4d289f56c08aaa025fad', 'request_id': 'req-92c4fcc0-6111-4264-9d42-0b98e711f7cd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.025476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] The token cache is being invalidate because project 8b04571018884e69818428e67d95c53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:14.026203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.026940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1aff26f5-df98-48b8-9999-f29cc781383f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.028749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1334/2648] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:13 2022] DELETE /identity/v3/projects/8b04571018884e69818428e67d95c53a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:14.033588 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6109e7-ce49-4ae5-98be-d578dd96d644 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.034426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6109e7-ce49-4ae5-98be-d578dd96d644 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.034907 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6109e7-ce49-4ae5-98be-d578dd96d644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.035696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097359f0dcfd4d289f56c08aaa025fad', 'request_id': 'req-92c4fcc0-6111-4264-9d42-0b98e711f7cd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.057595 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2d6109e7-ce49-4ae5-98be-d578dd96d644 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:14.058867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2d6109e7-ce49-4ae5-98be-d578dd96d644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:14.059145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] The token cache is being invalidate because project 097359f0dcfd4d289f56c08aaa025fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:14.059451 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.060185 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.062517 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1315/2649] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:13 2022] DELETE /identity/v3/projects/097359f0dcfd4d289f56c08aaa025fad => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:14.064222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:14.066448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:14.108613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:14.141917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1335/2650] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:14.142687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6109e7-ce49-4ae5-98be-d578dd96d644 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:14.143999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2d6109e7-ce49-4ae5-98be-d578dd96d644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:14.160273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6109e7-ce49-4ae5-98be-d578dd96d644 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:14.168543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:14.169671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.170181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.170709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] PATH_INFO: `/v3/users/ce6ca99913bd42feb23aecc903bf3d0f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.172864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6ca99913bd42feb23aecc903bf3d0f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:14.176675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:14.176964 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4fcc0-6111-4264-9d42-0b98e711f7cd admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:14.191741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:14.192913 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.193356 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.193908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] PATH_INFO: `/v3/users/61d6c0fce2c1453cb4d8e7216b72c7a2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.200114 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d6c0fce2c1453cb4d8e7216b72c7a2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:14.203873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:14.256655 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6ca99913bd42feb23aecc903bf3d0f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.257498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6ca99913bd42feb23aecc903bf3d0f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.275039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d6c0fce2c1453cb4d8e7216b72c7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.275761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d6c0fce2c1453cb4d8e7216b72c7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.276491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d6c0fce2c1453cb4d8e7216b72c7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.278698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6ca99913bd42feb23aecc903bf3d0f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.291711 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d6c0fce2c1453cb4d8e7216b72c7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.294202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6ca99913bd42feb23aecc903bf3d0f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.300938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d6c0fce2c1453cb4d8e7216b72c7a2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.305146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5e8a9aeb-4956-4ee3-8f60-f448f77035c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6ca99913bd42feb23aecc903bf3d0f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:14.314176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1336/2651] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:14 2022] DELETE /identity/v3/users/ce6ca99913bd42feb23aecc903bf3d0f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:14.315818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ad3c-b221-45f2-a602-71ac4d238ae5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.316153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ad3c-b221-45f2-a602-71ac4d238ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.316424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ad3c-b221-45f2-a602-71ac4d238ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.327403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1316/2652] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:14 2022] DELETE /identity/v3/users/61d6c0fce2c1453cb4d8e7216b72c7a2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:14.345164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1708ad3c-b221-45f2-a602-71ac4d238ae5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:14.347469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1708ad3c-b221-45f2-a602-71ac4d238ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:14.432515 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1337/2653] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:14.437463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:14.448633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6227-2cf8-41d6-966f-e4f650457bed admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:14.459435 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680e384-8ebe-4be0-b069-1e326ed36b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:14.468031 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680e384-8ebe-4be0-b069-1e326ed36b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.468419 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680e384-8ebe-4be0-b069-1e326ed36b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.468819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680e384-8ebe-4be0-b069-1e326ed36b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.469568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680e384-8ebe-4be0-b069-1e326ed36b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:43:14.470058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680e384-8ebe-4be0-b069-1e326ed36b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:14.471811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680e384-8ebe-4be0-b069-1e326ed36b5f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:14.487401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1317/2654] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:43:14.493083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ad3c-b221-45f2-a602-71ac4d238ae5 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:14.511702 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ad3c-b221-45f2-a602-71ac4d238ae5 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:14.519372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1299bf-7026-4c21-8dce-a779b375874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:14.520051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1299bf-7026-4c21-8dce-a779b375874c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.520325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1299bf-7026-4c21-8dce-a779b375874c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.520786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1299bf-7026-4c21-8dce-a779b375874c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.521517 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1299bf-7026-4c21-8dce-a779b375874c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:14.523642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1299bf-7026-4c21-8dce-a779b375874c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:14.531229 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:14.573268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1338/2655] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:14 2022] POST /identity/v3/projects => generated 405 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:14.576652 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680e384-8ebe-4be0-b069-1e326ed36b5f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:14.597476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680e384-8ebe-4be0-b069-1e326ed36b5f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:14.692806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b2b87-7fa4-4bae-b563-d1989c2bf100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:14.694341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b2b87-7fa4-4bae-b563-d1989c2bf100 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.695060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b2b87-7fa4-4bae-b563-d1989c2bf100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.696006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b2b87-7fa4-4bae-b563-d1989c2bf100 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.697260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b2b87-7fa4-4bae-b563-d1989c2bf100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:14.701236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b2b87-7fa4-4bae-b563-d1989c2bf100 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:14.749648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1318/2656] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:14 2022] POST /identity/v3/users => generated 303 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:14.752421 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1299bf-7026-4c21-8dce-a779b375874c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:14.767867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1299bf-7026-4c21-8dce-a779b375874c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:14.775188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a391-01b0-445b-9508-a3dfdf2072fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:14.776152 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a391-01b0-445b-9508-a3dfdf2072fa admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.776617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a391-01b0-445b-9508-a3dfdf2072fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.776995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a391-01b0-445b-9508-a3dfdf2072fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.778385 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a391-01b0-445b-9508-a3dfdf2072fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:14.780526 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a391-01b0-445b-9508-a3dfdf2072fa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:14.794700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1339/2657] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:14.798060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b2b87-7fa4-4bae-b563-d1989c2bf100 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:14.813824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b2b87-7fa4-4bae-b563-d1989c2bf100 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:14.823881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fd380-f771-47de-920d-6ce41ea85fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:14.823881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fd380-f771-47de-920d-6ce41ea85fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.824676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fd380-f771-47de-920d-6ce41ea85fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.824676 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fd380-f771-47de-920d-6ce41ea85fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.825678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fd380-f771-47de-920d-6ce41ea85fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:14.829258 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fd380-f771-47de-920d-6ce41ea85fcf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:14.852828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1319/2658] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:14.854782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a391-01b0-445b-9508-a3dfdf2072fa admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:14.867783 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a391-01b0-445b-9508-a3dfdf2072fa admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:14.877735 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc0f09-8399-4a0a-87a9-cb35b8907dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:14.878899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc0f09-8399-4a0a-87a9-cb35b8907dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.879538 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc0f09-8399-4a0a-87a9-cb35b8907dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.879988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc0f09-8399-4a0a-87a9-cb35b8907dd9 admin admin] PATH_INFO: `/v3/projects/8070444478d1445f89cbbad8281d10c3/users/02cc237a02984ed3b8ba79e713097096/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.911646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc0f09-8399-4a0a-87a9-cb35b8907dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8070444478d1445f89cbbad8281d10c3, user_id=02cc237a02984ed3b8ba79e713097096, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:14.916489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc0f09-8399-4a0a-87a9-cb35b8907dd9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:14.936878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1340/2659] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:14 2022] PUT /identity/v3/projects/8070444478d1445f89cbbad8281d10c3/users/02cc237a02984ed3b8ba79e713097096/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:43:14.950050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d721f7-775f-4aac-85eb-1551ca8303a4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:14.950436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d721f7-775f-4aac-85eb-1551ca8303a4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:14.950853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d721f7-775f-4aac-85eb-1551ca8303a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:14.987027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:15.007349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-84d721f7-775f-4aac-85eb-1551ca8303a4 None None] MFA Rules not processed for user `02cc237a02984ed3b8ba79e713097096`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:15.010495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-84d721f7-775f-4aac-85eb-1551ca8303a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.012746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc0f09-8399-4a0a-87a9-cb35b8907dd9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:15.017969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8ffc0f09-8399-4a0a-87a9-cb35b8907dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.140674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1320/2660] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:14 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:15.147720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d721f7-775f-4aac-85eb-1551ca8303a4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:15.149644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc0f09-8399-4a0a-87a9-cb35b8907dd9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:15.157359 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:15.158020 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.158213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.158583 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] PATH_INFO: `/v3/projects/9a5aa66649ca47108abc62d37bd80381` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.159962 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5aa66649ca47108abc62d37bd80381)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:15.163222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:15.166592 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d721f7-775f-4aac-85eb-1551ca8303a4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:15.174239 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38db6b-ce44-4b1e-8cc7-fb91b5e061cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:15.176638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38db6b-ce44-4b1e-8cc7-fb91b5e061cb admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.177135 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38db6b-ce44-4b1e-8cc7-fb91b5e061cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.177740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38db6b-ce44-4b1e-8cc7-fb91b5e061cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.180232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38db6b-ce44-4b1e-8cc7-fb91b5e061cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:15.185319 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38db6b-ce44-4b1e-8cc7-fb91b5e061cb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:15.238336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1321/2661] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:15 2022] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:15.240590 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38db6b-ce44-4b1e-8cc7-fb91b5e061cb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:15.243439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0d38db6b-ce44-4b1e-8cc7-fb91b5e061cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.277707 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5aa66649ca47108abc62d37bd80381', 'request_id': 'req-20c757b4-1b48-4f65-a767-5d06f9aaa293'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.290772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5aa66649ca47108abc62d37bd80381', 'request_id': 'req-20c757b4-1b48-4f65-a767-5d06f9aaa293'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.300619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5aa66649ca47108abc62d37bd80381', 'request_id': 'req-20c757b4-1b48-4f65-a767-5d06f9aaa293'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.314485 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] The token cache is being invalidate because project 9a5aa66649ca47108abc62d37bd80381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:15.314912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.315688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.317540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1341/2662] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:15 2022] DELETE /identity/v3/projects/9a5aa66649ca47108abc62d37bd80381 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:15.318928 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:15.320165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.363646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38db6b-ce44-4b1e-8cc7-fb91b5e061cb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:15.369721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:15.370607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.370995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.371471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] PATH_INFO: `/v3/projects/bc2200f65c5d41d9932ebce583ddaa00` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.373259 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2200f65c5d41d9932ebce583ddaa00)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:15.375979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:15.387418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:15.419930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c757b4-1b48-4f65-a767-5d06f9aaa293 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:15.427547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786261f-5dc4-4c0f-9ca6-4f723ae535be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:15.428568 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786261f-5dc4-4c0f-9ca6-4f723ae535be admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.428934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786261f-5dc4-4c0f-9ca6-4f723ae535be admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.429299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786261f-5dc4-4c0f-9ca6-4f723ae535be admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.430390 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786261f-5dc4-4c0f-9ca6-4f723ae535be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:15.432544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786261f-5dc4-4c0f-9ca6-4f723ae535be admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:15.456687 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2200f65c5d41d9932ebce583ddaa00', 'request_id': 'req-52553272-de06-48af-9f3b-275121f4010b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.464328 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1342/2663] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:15 2022] POST /identity/v3/users => generated 308 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:15.467242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7ea52-c1a1-4268-9159-42e64d7adc2c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.468082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7ea52-c1a1-4268-9159-42e64d7adc2c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.468681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7ea52-c1a1-4268-9159-42e64d7adc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.469463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2200f65c5d41d9932ebce583ddaa00', 'request_id': 'req-52553272-de06-48af-9f3b-275121f4010b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.480194 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2200f65c5d41d9932ebce583ddaa00', 'request_id': 'req-52553272-de06-48af-9f3b-275121f4010b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.499367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6fe7ea52-c1a1-4268-9159-42e64d7adc2c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:15.501419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6fe7ea52-c1a1-4268-9159-42e64d7adc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.504374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] The token cache is being invalidate because project bc2200f65c5d41d9932ebce583ddaa00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:15.504785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.505916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.508377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1322/2664] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:15 2022] DELETE /identity/v3/projects/bc2200f65c5d41d9932ebce583ddaa00 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:15.512881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:15.513445 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.530912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:15.603815 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1343/2665] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:15.605332 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7ea52-c1a1-4268-9159-42e64d7adc2c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:15.607255 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6fe7ea52-c1a1-4268-9159-42e64d7adc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.633141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52553272-de06-48af-9f3b-275121f4010b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:15.640140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf61a5f-8e69-4e50-8e2f-bc11351f21ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:15.641111 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf61a5f-8e69-4e50-8e2f-bc11351f21ab admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.641583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf61a5f-8e69-4e50-8e2f-bc11351f21ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.642023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf61a5f-8e69-4e50-8e2f-bc11351f21ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.643138 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf61a5f-8e69-4e50-8e2f-bc11351f21ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:15.643259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7ea52-c1a1-4268-9159-42e64d7adc2c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:15.646159 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf61a5f-8e69-4e50-8e2f-bc11351f21ab admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:15.653614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:15.654672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.655145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.661711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] PATH_INFO: `/v3/users/a5c20031777d446fa46cefabebc89a7f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.664303 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c20031777d446fa46cefabebc89a7f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:15.665279 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1323/2666] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:15.667272 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88712f9-61ba-473d-a389-4334715e65cb None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.667625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88712f9-61ba-473d-a389-4334715e65cb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.667939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88712f9-61ba-473d-a389-4334715e65cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.668120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:15.694103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f88712f9-61ba-473d-a389-4334715e65cb None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:15.695361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f88712f9-61ba-473d-a389-4334715e65cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.707905 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1324/2667] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:15.708821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88712f9-61ba-473d-a389-4334715e65cb None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:15.723425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88712f9-61ba-473d-a389-4334715e65cb None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:15.732607 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42b183-630a-4851-af81-8a479a5627c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:15.735122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42b183-630a-4851-af81-8a479a5627c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.735122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42b183-630a-4851-af81-8a479a5627c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.735122 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42b183-630a-4851-af81-8a479a5627c6 admin admin] PATH_INFO: `/v3/projects/e3686064e91248f0be1612967576f476/users/05c85496730c471f958bd2bc475a02ff/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.761081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42b183-630a-4851-af81-8a479a5627c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3686064e91248f0be1612967576f476, user_id=05c85496730c471f958bd2bc475a02ff, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:15.764494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42b183-630a-4851-af81-8a479a5627c6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:15.768851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c20031777d446fa46cefabebc89a7f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.769872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c20031777d446fa46cefabebc89a7f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.787262 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1325/2668] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:15 2022] PUT /identity/v3/projects/e3686064e91248f0be1612967576f476/users/05c85496730c471f958bd2bc475a02ff/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:15.789085 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42b183-630a-4851-af81-8a479a5627c6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:15.792127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2f42b183-630a-4851-af81-8a479a5627c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.800384 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c20031777d446fa46cefabebc89a7f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.811922 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c20031777d446fa46cefabebc89a7f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.822476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c20031777d446fa46cefabebc89a7f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:15.831347 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1344/2669] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:15 2022] DELETE /identity/v3/users/a5c20031777d446fa46cefabebc89a7f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:15.832861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:15.835469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:15.922709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42b183-630a-4851-af81-8a479a5627c6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:15.926243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:15.960161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a854d9-2c5e-45e0-a51e-3d22b627ebcc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:15.965349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebd97-4fac-4a85-9239-ff1ec79cd9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:15.965995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebd97-4fac-4a85-9239-ff1ec79cd9de admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:15.966269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebd97-4fac-4a85-9239-ff1ec79cd9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:15.966710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebd97-4fac-4a85-9239-ff1ec79cd9de admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:15.967429 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ebd97-4fac-4a85-9239-ff1ec79cd9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:15.969387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ebd97-4fac-4a85-9239-ff1ec79cd9de admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:15.986097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1345/2670] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:15.991942 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebd97-4fac-4a85-9239-ff1ec79cd9de admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.012026 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebd97-4fac-4a85-9239-ff1ec79cd9de admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.026131 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a60ca7-b4ca-4607-93c2-dec3a9331b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.027646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60ca7-b4ca-4607-93c2-dec3a9331b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.028414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60ca7-b4ca-4607-93c2-dec3a9331b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.029530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60ca7-b4ca-4607-93c2-dec3a9331b81 admin admin] PATH_INFO: `/v3/projects/e3686064e91248f0be1612967576f476/users/05c85496730c471f958bd2bc475a02ff/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.031395 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19ee3-1d09-4d9d-8223-8f19360bdf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.032509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19ee3-1d09-4d9d-8223-8f19360bdf14 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.033089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19ee3-1d09-4d9d-8223-8f19360bdf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.033720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e19ee3-1d09-4d9d-8223-8f19360bdf14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.035105 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19ee3-1d09-4d9d-8223-8f19360bdf14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:43:16.035828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19ee3-1d09-4d9d-8223-8f19360bdf14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.036357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a60ca7-b4ca-4607-93c2-dec3a9331b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3686064e91248f0be1612967576f476, user_id=05c85496730c471f958bd2bc475a02ff, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.039094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e19ee3-1d09-4d9d-8223-8f19360bdf14 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.043275 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a60ca7-b4ca-4607-93c2-dec3a9331b81 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.060965 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1326/2671] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:43:16.064626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1346/2672] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:15 2022] PUT /identity/v3/projects/e3686064e91248f0be1612967576f476/users/05c85496730c471f958bd2bc475a02ff/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:43:16.068342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19ee3-1d09-4d9d-8223-8f19360bdf14 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.085663 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796b4c6-935a-4d84-ba46-61785705d246 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.088188 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796b4c6-935a-4d84-ba46-61785705d246 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.090273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796b4c6-935a-4d84-ba46-61785705d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.096379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e19ee3-1d09-4d9d-8223-8f19360bdf14 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.123539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:16.161506 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5796b4c6-935a-4d84-ba46-61785705d246 None None] MFA Rules not processed for user `05c85496730c471f958bd2bc475a02ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:16.163537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5796b4c6-935a-4d84-ba46-61785705d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:16.224413 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d66f8a-5623-4a6e-977a-f2252324e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.226569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d66f8a-5623-4a6e-977a-f2252324e232 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.227157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d66f8a-5623-4a6e-977a-f2252324e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.228016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d66f8a-5623-4a6e-977a-f2252324e232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.230163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d66f8a-5623-4a6e-977a-f2252324e232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.234006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d66f8a-5623-4a6e-977a-f2252324e232 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.285367 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1327/2673] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:16 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:16.291176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d66f8a-5623-4a6e-977a-f2252324e232 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.334834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1347/2674] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:16.335900 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796b4c6-935a-4d84-ba46-61785705d246 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.337606 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5796b4c6-935a-4d84-ba46-61785705d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:16.360961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796b4c6-935a-4d84-ba46-61785705d246 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.396614 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d66f8a-5623-4a6e-977a-f2252324e232 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.406416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ad43e-729e-4624-b4fd-256549dfcdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.407926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ad43e-729e-4624-b4fd-256549dfcdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.408534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ad43e-729e-4624-b4fd-256549dfcdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.409006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ad43e-729e-4624-b4fd-256549dfcdf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.410153 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ad43e-729e-4624-b4fd-256549dfcdf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.414008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ad43e-729e-4624-b4fd-256549dfcdf1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.443133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.445848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.445848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.445848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] PATH_INFO: `/v3/projects/786396d49ef64b8a8d9f132f5697060f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.445848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=786396d49ef64b8a8d9f132f5697060f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.448087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.459618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1328/2675] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:16 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:16.459618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ad43e-729e-4624-b4fd-256549dfcdf1 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.459618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b87ad43e-729e-4624-b4fd-256549dfcdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:16.510693 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786396d49ef64b8a8d9f132f5697060f', 'request_id': 'req-853c5c54-3cc4-4643-9489-e16f5c685ac4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:16.515892 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:16.520809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786396d49ef64b8a8d9f132f5697060f', 'request_id': 'req-853c5c54-3cc4-4643-9489-e16f5c685ac4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:16.543030 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786396d49ef64b8a8d9f132f5697060f', 'request_id': 'req-853c5c54-3cc4-4643-9489-e16f5c685ac4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:16.545601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ad43e-729e-4624-b4fd-256549dfcdf1 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.560359 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] The token cache is being invalidate because project 786396d49ef64b8a8d9f132f5697060f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:16.560820 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:16.561969 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:16.564404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1348/2676] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:16 2022] DELETE /identity/v3/projects/786396d49ef64b8a8d9f132f5697060f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:16.570433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.570433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:16.632589 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:16.643697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876edd-5839-41b7-ae61-308bdf805976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.644973 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876edd-5839-41b7-ae61-308bdf805976 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.645582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876edd-5839-41b7-ae61-308bdf805976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.649082 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876edd-5839-41b7-ae61-308bdf805976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.651864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9f876edd-5839-41b7-ae61-308bdf805976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:16.660817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c5c54-3cc4-4643-9489-e16f5c685ac4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.676243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af593a28-1b0c-4cb5-a610-ac9b9304dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.677327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af593a28-1b0c-4cb5-a610-ac9b9304dfef admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.677725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af593a28-1b0c-4cb5-a610-ac9b9304dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.678062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af593a28-1b0c-4cb5-a610-ac9b9304dfef admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.679057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af593a28-1b0c-4cb5-a610-ac9b9304dfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.683521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af593a28-1b0c-4cb5-a610-ac9b9304dfef admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.707647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1349/2677] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:16.707647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75bd26-25d5-4d03-af6b-5eda8dd977b6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.707647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75bd26-25d5-4d03-af6b-5eda8dd977b6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.707647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75bd26-25d5-4d03-af6b-5eda8dd977b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.746677 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5c75bd26-25d5-4d03-af6b-5eda8dd977b6 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:16.749846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5c75bd26-25d5-4d03-af6b-5eda8dd977b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:16.765689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1350/2678] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:16.767473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75bd26-25d5-4d03-af6b-5eda8dd977b6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.780500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876edd-5839-41b7-ae61-308bdf805976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.783172 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876edd-5839-41b7-ae61-308bdf805976 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.786563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75bd26-25d5-4d03-af6b-5eda8dd977b6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.795437 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483e007-fad8-4d8a-b64b-6de9106922e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.796703 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483e007-fad8-4d8a-b64b-6de9106922e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.797174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483e007-fad8-4d8a-b64b-6de9106922e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.797645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483e007-fad8-4d8a-b64b-6de9106922e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.798946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483e007-fad8-4d8a-b64b-6de9106922e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.801941 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483e007-fad8-4d8a-b64b-6de9106922e0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.811458 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1329/2679] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:16 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:16.813480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22efb-a0c5-44c6-9e21-711a898ff422 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.813865 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22efb-a0c5-44c6-9e21-711a898ff422 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.814231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22efb-a0c5-44c6-9e21-711a898ff422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.821685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1351/2680] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:16.829258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483e007-fad8-4d8a-b64b-6de9106922e0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.838128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cec22efb-a0c5-44c6-9e21-711a898ff422 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:16.839580 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cec22efb-a0c5-44c6-9e21-711a898ff422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:16.845548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483e007-fad8-4d8a-b64b-6de9106922e0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.849921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1330/2681] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:16.855660 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec22efb-a0c5-44c6-9e21-711a898ff422 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.856544 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced76c0-78c4-450a-81a7-4de7fdcc5aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.857761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced76c0-78c4-450a-81a7-4de7fdcc5aad admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.858259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced76c0-78c4-450a-81a7-4de7fdcc5aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.859034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced76c0-78c4-450a-81a7-4de7fdcc5aad admin admin] PATH_INFO: `/v3/projects/68fbe2908c054860a8424803fc82ca8d/users/059590563d49468f90913a148b541ed0/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.868039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec22efb-a0c5-44c6-9e21-711a898ff422 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.879808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917d0f-58a8-474d-9642-8401d5376a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:16.880762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917d0f-58a8-474d-9642-8401d5376a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.881242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917d0f-58a8-474d-9642-8401d5376a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.881700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917d0f-58a8-474d-9642-8401d5376a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.882852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917d0f-58a8-474d-9642-8401d5376a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:43:16.883405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917d0f-58a8-474d-9642-8401d5376a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.883863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced76c0-78c4-450a-81a7-4de7fdcc5aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fbe2908c054860a8424803fc82ca8d, user_id=059590563d49468f90913a148b541ed0, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:16.886848 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced76c0-78c4-450a-81a7-4de7fdcc5aad admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.887812 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917d0f-58a8-474d-9642-8401d5376a8e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:16.911414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1331/2682] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:43:16.917744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1352/2683] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:16 2022] PUT /identity/v3/projects/68fbe2908c054860a8424803fc82ca8d/users/059590563d49468f90913a148b541ed0/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:16.918275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917d0f-58a8-474d-9642-8401d5376a8e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:16.939171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917d0f-58a8-474d-9642-8401d5376a8e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:16.939912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342aa3-bf45-4296-944a-806f4dd0efaa None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:16.939912 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342aa3-bf45-4296-944a-806f4dd0efaa None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:16.940227 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342aa3-bf45-4296-944a-806f4dd0efaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:16.998950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0b342aa3-bf45-4296-944a-806f4dd0efaa None None] MFA Rules not processed for user `059590563d49468f90913a148b541ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:17.002149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0b342aa3-bf45-4296-944a-806f4dd0efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:17.054415 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3f23c-8a2b-43aa-827c-4932e4532161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:17.055916 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f23c-8a2b-43aa-827c-4932e4532161 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.056337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f23c-8a2b-43aa-827c-4932e4532161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.056951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f23c-8a2b-43aa-827c-4932e4532161 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.058191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3f23c-8a2b-43aa-827c-4932e4532161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:17.062002 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3f23c-8a2b-43aa-827c-4932e4532161 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:17.105183 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1332/2684] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:16 2022] POST /identity/v3/projects => generated 391 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:17.106251 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3f23c-8a2b-43aa-827c-4932e4532161 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:17.108065 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-58e3f23c-8a2b-43aa-827c-4932e4532161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:17.131797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1353/2685] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:17.133641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b342aa3-bf45-4296-944a-806f4dd0efaa None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:17.153819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b342aa3-bf45-4296-944a-806f4dd0efaa None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:17.188835 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:17.232808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3f23c-8a2b-43aa-827c-4932e4532161 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:17.240496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:17.241433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.241838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.242205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] PATH_INFO: `/v3/users/02cc237a02984ed3b8ba79e713097096` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.243793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] RBAC: Authorizing `identity:delete_user(user_id=02cc237a02984ed3b8ba79e713097096)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:17.246756 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:17.252133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:17.262312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d750-e898-41cc-a0aa-761219ed596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:17.263773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d750-e898-41cc-a0aa-761219ed596c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.264327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d750-e898-41cc-a0aa-761219ed596c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.264571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d750-e898-41cc-a0aa-761219ed596c admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.266171 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06d750-e898-41cc-a0aa-761219ed596c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:17.268133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06d750-e898-41cc-a0aa-761219ed596c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:17.298736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1354/2686] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:17 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:17.299973 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d750-e898-41cc-a0aa-761219ed596c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:17.302372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5b06d750-e898-41cc-a0aa-761219ed596c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:17.336162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02cc237a02984ed3b8ba79e713097096'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:17.337245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02cc237a02984ed3b8ba79e713097096'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:17.338278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02cc237a02984ed3b8ba79e713097096'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:17.365739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02cc237a02984ed3b8ba79e713097096'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:17.380857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02cc237a02984ed3b8ba79e713097096'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:17.409853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1333/2687] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:17 2022] DELETE /identity/v3/users/02cc237a02984ed3b8ba79e713097096 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:17.411695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:17.414140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:17.424752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d750-e898-41cc-a0aa-761219ed596c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:17.514801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:17.515525 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.515925 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.516258 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.519837 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:17.541342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb738b6-78b8-4b3c-9c65-7debd804402b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:17.548035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c907e0-7d73-4bb2-a5e2-c200cee20f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:17.548826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c907e0-7d73-4bb2-a5e2-c200cee20f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.549219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c907e0-7d73-4bb2-a5e2-c200cee20f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.550107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c907e0-7d73-4bb2-a5e2-c200cee20f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.550932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c907e0-7d73-4bb2-a5e2-c200cee20f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:17.553014 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c907e0-7d73-4bb2-a5e2-c200cee20f07 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:17.572026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1334/2688] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:17.577985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e40c5-3522-4241-927b-54ea91dbb3e4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.578505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e40c5-3522-4241-927b-54ea91dbb3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.580210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e40c5-3522-4241-927b-54ea91dbb3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.618004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-688e40c5-3522-4241-927b-54ea91dbb3e4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:17.620357 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-688e40c5-3522-4241-927b-54ea91dbb3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:17.628894 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:17.630395 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:17.638249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1335/2689] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:17.640497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e40c5-3522-4241-927b-54ea91dbb3e4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:17.644974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1355/2690] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:17.653660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:17.659765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:17.662311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e40c5-3522-4241-927b-54ea91dbb3e4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:17.670127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7779d1d-fc7c-4979-b55c-25a4fb8f6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:17.671502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7779d1d-fc7c-4979-b55c-25a4fb8f6d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.671895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7779d1d-fc7c-4979-b55c-25a4fb8f6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.672310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7779d1d-fc7c-4979-b55c-25a4fb8f6d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.673355 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7779d1d-fc7c-4979-b55c-25a4fb8f6d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:17.675996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7779d1d-fc7c-4979-b55c-25a4fb8f6d82 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:17.700906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1336/2691] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:17.704474 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7779d1d-fc7c-4979-b55c-25a4fb8f6d82 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:17.711177 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:17.722961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7779d1d-fc7c-4979-b55c-25a4fb8f6d82 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:17.730755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12deebc-4822-4ca8-9ce5-11590dd181a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:17.731949 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12deebc-4822-4ca8-9ce5-11590dd181a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.732344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12deebc-4822-4ca8-9ce5-11590dd181a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.732729 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12deebc-4822-4ca8-9ce5-11590dd181a4 admin admin] PATH_INFO: `/v3/projects/5e80aabf0f764f8c9b8ac402a77a62d1/users/a66fb9f88fd84f2e82e6677d6ab74514/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.751203 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124eeea-8d95-456d-9571-c84547174b3e service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:17.757086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473f190-27c3-4f5f-b3a7-bc6c11512669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:17.758329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473f190-27c3-4f5f-b3a7-bc6c11512669 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.758329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473f190-27c3-4f5f-b3a7-bc6c11512669 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.758643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473f190-27c3-4f5f-b3a7-bc6c11512669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.763932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12deebc-4822-4ca8-9ce5-11590dd181a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e80aabf0f764f8c9b8ac402a77a62d1, user_id=a66fb9f88fd84f2e82e6677d6ab74514, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:17.768757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12deebc-4822-4ca8-9ce5-11590dd181a4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:17.772865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473f190-27c3-4f5f-b3a7-bc6c11512669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:17.773750 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473f190-27c3-4f5f-b3a7-bc6c11512669 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:17.788344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1356/2692] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:17.793615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1337/2693] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:17 2022] PUT /identity/v3/projects/5e80aabf0f764f8c9b8ac402a77a62d1/users/a66fb9f88fd84f2e82e6677d6ab74514/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:17.810424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4acd9-5aab-44af-9e68-8241b5fed962 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:17.810938 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4acd9-5aab-44af-9e68-8241b5fed962 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:17.811394 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4acd9-5aab-44af-9e68-8241b5fed962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:17.858164 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b3c4acd9-5aab-44af-9e68-8241b5fed962 None None] MFA Rules not processed for user `a66fb9f88fd84f2e82e6677d6ab74514`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:17.860072 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b3c4acd9-5aab-44af-9e68-8241b5fed962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:17.996878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1357/2694] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:18.013134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12deebc-4822-4ca8-9ce5-11590dd181a4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:18.020120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e12deebc-4822-4ca8-9ce5-11590dd181a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:18.113707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:18.153329 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12deebc-4822-4ca8-9ce5-11590dd181a4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:18.160578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5264f5-a2ef-4528-9035-1140b22e8a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:18.161712 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5264f5-a2ef-4528-9035-1140b22e8a8b service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:18.162000 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5264f5-a2ef-4528-9035-1140b22e8a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:18.162470 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5264f5-a2ef-4528-9035-1140b22e8a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:18.178493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5264f5-a2ef-4528-9035-1140b22e8a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:18.181326 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5264f5-a2ef-4528-9035-1140b22e8a8b service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:18.208879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1338/2695] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:43:18.384626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4acd9-5aab-44af-9e68-8241b5fed962 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:18.387762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b3c4acd9-5aab-44af-9e68-8241b5fed962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:18.527159 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4acd9-5aab-44af-9e68-8241b5fed962 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:18.534447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:18.535489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:18.535998 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:18.536335 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] PATH_INFO: `/v3/projects/8070444478d1445f89cbbad8281d10c3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:18.538224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8070444478d1445f89cbbad8281d10c3)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:18.540512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:18.619632 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8070444478d1445f89cbbad8281d10c3', 'request_id': 'req-b89077b2-492c-4435-8fe1-8d8ad6d014b4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.633223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8070444478d1445f89cbbad8281d10c3', 'request_id': 'req-b89077b2-492c-4435-8fe1-8d8ad6d014b4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.645419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8070444478d1445f89cbbad8281d10c3', 'request_id': 'req-b89077b2-492c-4435-8fe1-8d8ad6d014b4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.647839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:18.668782 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] The token cache is being invalidate because project 8070444478d1445f89cbbad8281d10c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:18.669169 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.670062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b89077b2-492c-4435-8fe1-8d8ad6d014b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.672167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1358/2696] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:18 2022] DELETE /identity/v3/projects/8070444478d1445f89cbbad8281d10c3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:18.676758 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5264f5-a2ef-4528-9035-1140b22e8a8b service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:18.694995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5264f5-a2ef-4528-9035-1140b22e8a8b service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:18.802378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:18.803142 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:18.803536 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:18.803940 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] PATH_INFO: `/v3/users/05c85496730c471f958bd2bc475a02ff` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:18.805697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c85496730c471f958bd2bc475a02ff)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:18.808006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:18.887794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c85496730c471f958bd2bc475a02ff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.888772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c85496730c471f958bd2bc475a02ff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.891137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c85496730c471f958bd2bc475a02ff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.921508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c85496730c471f958bd2bc475a02ff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.931910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c85496730c471f958bd2bc475a02ff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:18.949392 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1339/2697] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:18 2022] DELETE /identity/v3/users/05c85496730c471f958bd2bc475a02ff => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:19.317209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d301280-5707-40e8-b374-1b27906ced67 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:19.318711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d301280-5707-40e8-b374-1b27906ced67 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:19.319399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d301280-5707-40e8-b374-1b27906ced67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:19.350874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1d301280-5707-40e8-b374-1b27906ced67 None None] MFA Rules not processed for user `059590563d49468f90913a148b541ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:19.353082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1d301280-5707-40e8-b374-1b27906ced67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:19.381515 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:19.384852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:19.457205 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1359/2698] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:19.520300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:19.527264 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43f167-91e5-4a7b-8238-3c94ea92e4ba admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:19.537834 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:19.540999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:19.540999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:19.540999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] PATH_INFO: `/v3/projects/e3686064e91248f0be1612967576f476` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:19.543299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3686064e91248f0be1612967576f476)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:19.547063 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:19.641482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3686064e91248f0be1612967576f476', 'request_id': 'req-27a37051-61fb-4c0b-bab2-11ac4711a73c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:19.652024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3686064e91248f0be1612967576f476', 'request_id': 'req-27a37051-61fb-4c0b-bab2-11ac4711a73c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:19.661293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3686064e91248f0be1612967576f476', 'request_id': 'req-27a37051-61fb-4c0b-bab2-11ac4711a73c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:19.677721 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] The token cache is being invalidate because project e3686064e91248f0be1612967576f476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:19.678143 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:19.679055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-27a37051-61fb-4c0b-bab2-11ac4711a73c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:19.681808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1340/2699] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:19 2022] DELETE /identity/v3/projects/e3686064e91248f0be1612967576f476 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:19.693825 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655858e8-4462-4533-946d-448abeb38cfd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:19.694541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655858e8-4462-4533-946d-448abeb38cfd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:19.697772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655858e8-4462-4533-946d-448abeb38cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:19.736845 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-655858e8-4462-4533-946d-448abeb38cfd None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:19.739145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-655858e8-4462-4533-946d-448abeb38cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:19.847667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1360/2700] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:19.858534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6bffc-939d-4a25-b5cc-f0db630d1224 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:19.861058 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6bffc-939d-4a25-b5cc-f0db630d1224 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:19.861595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6bffc-939d-4a25-b5cc-f0db630d1224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:19.898303 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-36e6bffc-939d-4a25-b5cc-f0db630d1224 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:19.901535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-36e6bffc-939d-4a25-b5cc-f0db630d1224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:19.917554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1341/2701] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:19.924240 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655858e8-4462-4533-946d-448abeb38cfd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:19.943602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655858e8-4462-4533-946d-448abeb38cfd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:19.957957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63be4d-5ccd-4878-9ebd-c24dca3e309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:19.959285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63be4d-5ccd-4878-9ebd-c24dca3e309a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:19.959918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63be4d-5ccd-4878-9ebd-c24dca3e309a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:19.960523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63be4d-5ccd-4878-9ebd-c24dca3e309a admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:19.963479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63be4d-5ccd-4878-9ebd-c24dca3e309a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:43:19.964126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63be4d-5ccd-4878-9ebd-c24dca3e309a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:19.967554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63be4d-5ccd-4878-9ebd-c24dca3e309a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:19.994700 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1361/2702] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:43:20.000893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6bffc-939d-4a25-b5cc-f0db630d1224 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:20.020765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6bffc-939d-4a25-b5cc-f0db630d1224 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:20.026332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc6963-5e55-42cb-96d3-491220bcc7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:20.027544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc6963-5e55-42cb-96d3-491220bcc7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.027544 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc6963-5e55-42cb-96d3-491220bcc7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.027936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc6963-5e55-42cb-96d3-491220bcc7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.028358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc6963-5e55-42cb-96d3-491220bcc7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:20.030766 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc6963-5e55-42cb-96d3-491220bcc7a5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:20.082875 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1342/2703] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:19 2022] POST /identity/v3/projects => generated 363 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:20.089843 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63be4d-5ccd-4878-9ebd-c24dca3e309a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:20.111639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63be4d-5ccd-4878-9ebd-c24dca3e309a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:20.219157 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525f0a7-c489-4ad8-8679-b7c28dbfceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:20.220176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525f0a7-c489-4ad8-8679-b7c28dbfceb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.220623 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525f0a7-c489-4ad8-8679-b7c28dbfceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.221138 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525f0a7-c489-4ad8-8679-b7c28dbfceb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.221824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525f0a7-c489-4ad8-8679-b7c28dbfceb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:20.224450 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525f0a7-c489-4ad8-8679-b7c28dbfceb7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:20.256944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1362/2704] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:20 2022] POST /identity/v3/users => generated 282 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:20.263586 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc6963-5e55-42cb-96d3-491220bcc7a5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:20.286290 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc6963-5e55-42cb-96d3-491220bcc7a5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:20.292980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ac9d-2673-40dc-bfd7-1156fc971013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:20.293701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ac9d-2673-40dc-bfd7-1156fc971013 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.294044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ac9d-2673-40dc-bfd7-1156fc971013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.294537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ac9d-2673-40dc-bfd7-1156fc971013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.295300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79ac9d-2673-40dc-bfd7-1156fc971013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:20.297231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79ac9d-2673-40dc-bfd7-1156fc971013 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:20.322079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525f0a7-c489-4ad8-8679-b7c28dbfceb7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:20.322828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1343/2705] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:20.333824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525f0a7-c489-4ad8-8679-b7c28dbfceb7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:20.341725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bec07-98b5-471a-8dba-ac2a2d166681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:20.342952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bec07-98b5-471a-8dba-ac2a2d166681 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.343481 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bec07-98b5-471a-8dba-ac2a2d166681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.343976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bec07-98b5-471a-8dba-ac2a2d166681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.345212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bec07-98b5-471a-8dba-ac2a2d166681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:20.348361 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bec07-98b5-471a-8dba-ac2a2d166681 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:20.363811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:20.382334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1363/2706] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:20.384260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ac9d-2673-40dc-bfd7-1156fc971013 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:20.400311 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ac9d-2673-40dc-bfd7-1156fc971013 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:20.405393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1f50e-9383-4c48-b6dc-0e279182207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:20.406233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1f50e-9383-4c48-b6dc-0e279182207c admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.406511 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1f50e-9383-4c48-b6dc-0e279182207c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.406897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1f50e-9383-4c48-b6dc-0e279182207c admin admin] PATH_INFO: `/v3/projects/21fdfd8e0b3f4e508f3acfb02af76592/users/2913bab5ee1d4c7396cde3792b142d29/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.425800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1f50e-9383-4c48-b6dc-0e279182207c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fdfd8e0b3f4e508f3acfb02af76592, user_id=2913bab5ee1d4c7396cde3792b142d29, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:20.428380 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1f50e-9383-4c48-b6dc-0e279182207c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:20.446528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1344/2707] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:20 2022] PUT /identity/v3/projects/21fdfd8e0b3f4e508f3acfb02af76592/users/2913bab5ee1d4c7396cde3792b142d29/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:43:20.459957 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dddc03-8e22-4bd8-b345-ebd044c7bed9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.460445 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dddc03-8e22-4bd8-b345-ebd044c7bed9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.460818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dddc03-8e22-4bd8-b345-ebd044c7bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.508608 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-28dddc03-8e22-4bd8-b345-ebd044c7bed9 None None] MFA Rules not processed for user `2913bab5ee1d4c7396cde3792b142d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:20.510139 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-28dddc03-8e22-4bd8-b345-ebd044c7bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:20.618641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1364/2708] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:20.619379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1f50e-9383-4c48-b6dc-0e279182207c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:20.697530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1f50e-9383-4c48-b6dc-0e279182207c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:20.705997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56ab2-04cc-48d8-b006-aa8db8e0c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:20.706569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56ab2-04cc-48d8-b006-aa8db8e0c17d admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.707070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56ab2-04cc-48d8-b006-aa8db8e0c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.707253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56ab2-04cc-48d8-b006-aa8db8e0c17d admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.707815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d56ab2-04cc-48d8-b006-aa8db8e0c17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:20.709728 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d56ab2-04cc-48d8-b006-aa8db8e0c17d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:20.748209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1345/2709] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:20 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:20.752917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dddc03-8e22-4bd8-b345-ebd044c7bed9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:20.770092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dddc03-8e22-4bd8-b345-ebd044c7bed9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:20.869913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39ce1f-a48a-433c-a867-048184b7c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:20.870566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39ce1f-a48a-433c-a867-048184b7c34d admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.870928 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39ce1f-a48a-433c-a867-048184b7c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.871263 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39ce1f-a48a-433c-a867-048184b7c34d admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.871930 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39ce1f-a48a-433c-a867-048184b7c34d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:20.873940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39ce1f-a48a-433c-a867-048184b7c34d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:20.906991 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1365/2710] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:20 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:20.911282 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56ab2-04cc-48d8-b006-aa8db8e0c17d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:20.922788 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56ab2-04cc-48d8-b006-aa8db8e0c17d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:20.927591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871decb3-c823-4434-ad4e-642afe34a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:20.928224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871decb3-c823-4434-ad4e-642afe34a0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.928494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871decb3-c823-4434-ad4e-642afe34a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.928763 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871decb3-c823-4434-ad4e-642afe34a0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.929787 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871decb3-c823-4434-ad4e-642afe34a0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:20.931618 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871decb3-c823-4434-ad4e-642afe34a0b0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:20.934268 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:20.946391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1346/2711] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:43:20.952953 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39ce1f-a48a-433c-a867-048184b7c34d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:20.963769 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39ce1f-a48a-433c-a867-048184b7c34d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:20.969487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795729e8-0f9b-45f7-886d-1022f114d726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:20.969854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795729e8-0f9b-45f7-886d-1022f114d726 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:20.970061 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795729e8-0f9b-45f7-886d-1022f114d726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:20.970342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795729e8-0f9b-45f7-886d-1022f114d726 admin admin] PATH_INFO: `/v3/projects/a15bb45bc50a48d58667615e8ae9cd63/users/45083a7889cc493eb0673ce6aa513796/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:20.989148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795729e8-0f9b-45f7-886d-1022f114d726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15bb45bc50a48d58667615e8ae9cd63, user_id=45083a7889cc493eb0673ce6aa513796, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:20.994732 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795729e8-0f9b-45f7-886d-1022f114d726 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:21.020329 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1366/2712] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:20 2022] PUT /identity/v3/projects/a15bb45bc50a48d58667615e8ae9cd63/users/45083a7889cc493eb0673ce6aa513796/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:43:21.024715 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871decb3-c823-4434-ad4e-642afe34a0b0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:21.035482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871decb3-c823-4434-ad4e-642afe34a0b0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:21.105361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7e68e-b04f-4870-9e4d-157d91216928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:21.105970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7e68e-b04f-4870-9e4d-157d91216928 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:21.106267 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7e68e-b04f-4870-9e4d-157d91216928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:21.106561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7e68e-b04f-4870-9e4d-157d91216928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:21.107292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7e68e-b04f-4870-9e4d-157d91216928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:21.109176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7e68e-b04f-4870-9e4d-157d91216928 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:21.142016 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1347/2713] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:21.142143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795729e8-0f9b-45f7-886d-1022f114d726 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:21.149313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795729e8-0f9b-45f7-886d-1022f114d726 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:21.154345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e4538-c55c-4bda-8839-9ac955d9b218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:21.155300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4538-c55c-4bda-8839-9ac955d9b218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:21.155762 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4538-c55c-4bda-8839-9ac955d9b218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:21.156126 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4538-c55c-4bda-8839-9ac955d9b218 admin admin] PATH_INFO: `/v3/projects/a15bb45bc50a48d58667615e8ae9cd63/users/45083a7889cc493eb0673ce6aa513796/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:21.158245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e4538-c55c-4bda-8839-9ac955d9b218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15bb45bc50a48d58667615e8ae9cd63, user_id=45083a7889cc493eb0673ce6aa513796, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:21.160989 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e4538-c55c-4bda-8839-9ac955d9b218 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:21.184692 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1367/2714] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:21 2022] PUT /identity/v3/projects/a15bb45bc50a48d58667615e8ae9cd63/users/45083a7889cc493eb0673ce6aa513796/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:21.186316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bcd37-dfc2-442f-ae63-3441f389e4e0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:21.186838 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bcd37-dfc2-442f-ae63-3441f389e4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:21.187582 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bcd37-dfc2-442f-ae63-3441f389e4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:21.224534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4c3bcd37-dfc2-442f-ae63-3441f389e4e0 None None] MFA Rules not processed for user `45083a7889cc493eb0673ce6aa513796`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:21.225930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4c3bcd37-dfc2-442f-ae63-3441f389e4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:21.321823 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1348/2715] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:21.340076 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e4538-c55c-4bda-8839-9ac955d9b218 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:21.342099 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0b2e4538-c55c-4bda-8839-9ac955d9b218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:21.399101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:21.418522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e4538-c55c-4bda-8839-9ac955d9b218 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:21.424068 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947fb83-f4c0-46d6-a80d-e89ec03ba3ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:21.424650 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947fb83-f4c0-46d6-a80d-e89ec03ba3ec service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:21.424943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947fb83-f4c0-46d6-a80d-e89ec03ba3ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:21.425225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947fb83-f4c0-46d6-a80d-e89ec03ba3ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:21.437529 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947fb83-f4c0-46d6-a80d-e89ec03ba3ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:21.440427 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947fb83-f4c0-46d6-a80d-e89ec03ba3ec service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:21.460235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1368/2716] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:43:21.566767 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bcd37-dfc2-442f-ae63-3441f389e4e0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:21.583273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bcd37-dfc2-442f-ae63-3441f389e4e0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:21.595851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e563a-bbdf-41dd-9809-e8dceb44f3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:21.597353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e563a-bbdf-41dd-9809-e8dceb44f3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:21.597733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e563a-bbdf-41dd-9809-e8dceb44f3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:21.598175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e563a-bbdf-41dd-9809-e8dceb44f3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:21.718522 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e563a-bbdf-41dd-9809-e8dceb44f3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:21.720343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e563a-bbdf-41dd-9809-e8dceb44f3e5 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:21.734772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1349/2717] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:23.231870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947fb83-f4c0-46d6-a80d-e89ec03ba3ec service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:23.243162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2947fb83-f4c0-46d6-a80d-e89ec03ba3ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:23.341392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947fb83-f4c0-46d6-a80d-e89ec03ba3ec service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:23.347461 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63af386-8ea3-4f47-8924-f01d172aae02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:23.347775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63af386-8ea3-4f47-8924-f01d172aae02 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:23.347944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63af386-8ea3-4f47-8924-f01d172aae02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:23.348222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63af386-8ea3-4f47-8924-f01d172aae02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:23.350689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b63af386-8ea3-4f47-8924-f01d172aae02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:23.365191 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63af386-8ea3-4f47-8924-f01d172aae02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:23.367564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63af386-8ea3-4f47-8924-f01d172aae02 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:23.379464 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1369/2718] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:43:27.146633 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e563a-bbdf-41dd-9809-e8dceb44f3e5 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:27.172856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:27.234047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e563a-bbdf-41dd-9809-e8dceb44f3e5 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:27.239241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:27.239894 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:27.240176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:27.240564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] PATH_INFO: `/v3/users/2913bab5ee1d4c7396cde3792b142d29` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:27.241859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2913bab5ee1d4c7396cde3792b142d29)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:27.243989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:27.305601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2913bab5ee1d4c7396cde3792b142d29'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:27.306920 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2913bab5ee1d4c7396cde3792b142d29'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:27.307790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2913bab5ee1d4c7396cde3792b142d29'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:27.323869 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2913bab5ee1d4c7396cde3792b142d29'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:27.332743 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2913bab5ee1d4c7396cde3792b142d29'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:27.351427 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1350/2719] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:27 2022] DELETE /identity/v3/users/2913bab5ee1d4c7396cde3792b142d29 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:27.357904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0369925-bb3a-4f0a-abe0-734819a1b89f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:27.359274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0369925-bb3a-4f0a-abe0-734819a1b89f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:27.359528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0369925-bb3a-4f0a-abe0-734819a1b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:27.385967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e0369925-bb3a-4f0a-abe0-734819a1b89f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:27.387603 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e0369925-bb3a-4f0a-abe0-734819a1b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:27.475119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1370/2720] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:27.490359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:27.492896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:27.652668 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d1c0-8719-44ae-af65-0c7ea2cc2341 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:27.658193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aaba6-845d-4943-a1c4-2e4b8ddbf4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:27.659484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aaba6-845d-4943-a1c4-2e4b8ddbf4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:27.659698 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aaba6-845d-4943-a1c4-2e4b8ddbf4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:27.659908 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aaba6-845d-4943-a1c4-2e4b8ddbf4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:27.679284 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aaba6-845d-4943-a1c4-2e4b8ddbf4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:27.681473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aaba6-845d-4943-a1c4-2e4b8ddbf4d3 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:27.696682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1351/2721] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:28.441420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0369925-bb3a-4f0a-abe0-734819a1b89f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:28.444522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e0369925-bb3a-4f0a-abe0-734819a1b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:28.466468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0369925-bb3a-4f0a-abe0-734819a1b89f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:28.476888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:28.477635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:28.477914 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:28.478444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] PATH_INFO: `/v3/projects/21fdfd8e0b3f4e508f3acfb02af76592` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:28.480084 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21fdfd8e0b3f4e508f3acfb02af76592)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:28.482968 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:28.549056 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21fdfd8e0b3f4e508f3acfb02af76592', 'request_id': 'req-8fa97ae3-c303-4a6f-b153-4607c74ede93'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.558614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21fdfd8e0b3f4e508f3acfb02af76592', 'request_id': 'req-8fa97ae3-c303-4a6f-b153-4607c74ede93'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.569379 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21fdfd8e0b3f4e508f3acfb02af76592', 'request_id': 'req-8fa97ae3-c303-4a6f-b153-4607c74ede93'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.587408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] The token cache is being invalidate because project 21fdfd8e0b3f4e508f3acfb02af76592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:28.587689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.588491 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.590274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1371/2722] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:28 2022] DELETE /identity/v3/projects/21fdfd8e0b3f4e508f3acfb02af76592 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:28.596103 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aaba6-845d-4943-a1c4-2e4b8ddbf4d3 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:28.608233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aaba6-845d-4943-a1c4-2e4b8ddbf4d3 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:28.663000 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:28.695911 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:28.696731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:28.697060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:28.697320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] PATH_INFO: `/v3/users/45083a7889cc493eb0673ce6aa513796` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:28.698744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=45083a7889cc493eb0673ce6aa513796)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:28.700981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:28.766979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45083a7889cc493eb0673ce6aa513796'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.767659 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45083a7889cc493eb0673ce6aa513796'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.768484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45083a7889cc493eb0673ce6aa513796'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.783751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45083a7889cc493eb0673ce6aa513796'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.792201 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45083a7889cc493eb0673ce6aa513796'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:28.812479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1352/2723] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:28 2022] DELETE /identity/v3/users/45083a7889cc493eb0673ce6aa513796 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:29.244855 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:29.247455 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:29.285192 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa97ae3-c303-4a6f-b153-4607c74ede93 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:29.296029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:29.298796 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:29.306526 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:29.417196 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:29.418422 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:29.418943 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:29.419414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] PATH_INFO: `/v3/projects/a15bb45bc50a48d58667615e8ae9cd63` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:29.421863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15bb45bc50a48d58667615e8ae9cd63)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:29.425865 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:29.440399 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b80034-eb4b-4c57-b7a2-195d1cc653fa admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:29.449930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:29.451049 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:29.451496 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:29.451868 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] PATH_INFO: `/v3/users/a66fb9f88fd84f2e82e6677d6ab74514` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:29.454309 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66fb9f88fd84f2e82e6677d6ab74514)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:29.458527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:29.519321 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15bb45bc50a48d58667615e8ae9cd63', 'request_id': 'req-18856df3-17c1-4e9c-9c15-edde851b24ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.533959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15bb45bc50a48d58667615e8ae9cd63', 'request_id': 'req-18856df3-17c1-4e9c-9c15-edde851b24ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.549797 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66fb9f88fd84f2e82e6677d6ab74514'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.550799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66fb9f88fd84f2e82e6677d6ab74514'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.551695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15bb45bc50a48d58667615e8ae9cd63', 'request_id': 'req-18856df3-17c1-4e9c-9c15-edde851b24ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.551910 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66fb9f88fd84f2e82e6677d6ab74514'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.572256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:29.572572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] The token cache is being invalidate because project a15bb45bc50a48d58667615e8ae9cd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:29.572905 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.574079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-18856df3-17c1-4e9c-9c15-edde851b24ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.576498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66fb9f88fd84f2e82e6677d6ab74514'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.576698 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1372/2724] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:29 2022] DELETE /identity/v3/projects/a15bb45bc50a48d58667615e8ae9cd63 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:29.586053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86547-5850-4e72-b4ed-7ca2c4663cfd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:29.586685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86547-5850-4e72-b4ed-7ca2c4663cfd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:29.595189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-afc50196-c2e3-4320-b86e-d0220a146917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66fb9f88fd84f2e82e6677d6ab74514'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:29.596210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86547-5850-4e72-b4ed-7ca2c4663cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:29.621509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1353/2725] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:29 2022] DELETE /identity/v3/users/a66fb9f88fd84f2e82e6677d6ab74514 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:29.626807 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b282e2-0e6b-4a74-b5fd-cd053bee5242 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:29.627101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b282e2-0e6b-4a74-b5fd-cd053bee5242 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:29.627374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b282e2-0e6b-4a74-b5fd-cd053bee5242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:29.628761 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cef86547-5850-4e72-b4ed-7ca2c4663cfd None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:29.630377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cef86547-5850-4e72-b4ed-7ca2c4663cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:29.651718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b2b282e2-0e6b-4a74-b5fd-cd053bee5242 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:29.653006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b2b282e2-0e6b-4a74-b5fd-cd053bee5242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:29.750932 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1373/2726] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:29.757088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1354/2727] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:29.771228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86547-5850-4e72-b4ed-7ca2c4663cfd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:29.773037 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66a16c-7c29-4e41-a1f7-1a70dc3589d5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:29.773540 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66a16c-7c29-4e41-a1f7-1a70dc3589d5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:29.774035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66a16c-7c29-4e41-a1f7-1a70dc3589d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:29.775494 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cef86547-5850-4e72-b4ed-7ca2c4663cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:29.811609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6f66a16c-7c29-4e41-a1f7-1a70dc3589d5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:29.814022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6f66a16c-7c29-4e41-a1f7-1a70dc3589d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:29.825824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1355/2728] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:29.831364 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66a16c-7c29-4e41-a1f7-1a70dc3589d5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:29.841584 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66a16c-7c29-4e41-a1f7-1a70dc3589d5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:29.849152 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3305-71bf-4a0e-b284-d080e4ecbd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:29.850378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3305-71bf-4a0e-b284-d080e4ecbd73 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:29.850378 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3305-71bf-4a0e-b284-d080e4ecbd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:29.850701 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3305-71bf-4a0e-b284-d080e4ecbd73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:29.851233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3305-71bf-4a0e-b284-d080e4ecbd73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:43:29.851560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3305-71bf-4a0e-b284-d080e4ecbd73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:29.853408 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3305-71bf-4a0e-b284-d080e4ecbd73 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:29.858822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:29.876459 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86547-5850-4e72-b4ed-7ca2c4663cfd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:29.885747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b61e-e8cc-4101-9fc2-677f45f621e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:29.885995 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1356/2729] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:43:29.886145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b61e-e8cc-4101-9fc2-677f45f621e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:29.886145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b61e-e8cc-4101-9fc2-677f45f621e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:29.886145 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b61e-e8cc-4101-9fc2-677f45f621e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:29.887977 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3305-71bf-4a0e-b284-d080e4ecbd73 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:29.898130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07b61e-e8cc-4101-9fc2-677f45f621e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:29.900487 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07b61e-e8cc-4101-9fc2-677f45f621e4 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:29.905022 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3305-71bf-4a0e-b284-d080e4ecbd73 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:29.915505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be0f0-b472-4831-a0f3-ae7bc84595f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:29.916903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be0f0-b472-4831-a0f3-ae7bc84595f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:29.917661 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be0f0-b472-4831-a0f3-ae7bc84595f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:29.918403 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be0f0-b472-4831-a0f3-ae7bc84595f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:29.918737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1374/2730] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:29.919696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15be0f0-b472-4831-a0f3-ae7bc84595f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:29.924128 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15be0f0-b472-4831-a0f3-ae7bc84595f0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:30.186951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1357/2731] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:29 2022] POST /identity/v3/projects => generated 365 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:30.190180 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b61e-e8cc-4101-9fc2-677f45f621e4 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:30.211434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b61e-e8cc-4101-9fc2-677f45f621e4 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:30.312215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0249cf-da00-48ab-b8b5-5e5122cfde0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:30.312940 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0249cf-da00-48ab-b8b5-5e5122cfde0b admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.313223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0249cf-da00-48ab-b8b5-5e5122cfde0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.313547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0249cf-da00-48ab-b8b5-5e5122cfde0b admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.314350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0249cf-da00-48ab-b8b5-5e5122cfde0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:30.316607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0249cf-da00-48ab-b8b5-5e5122cfde0b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:30.349752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1375/2732] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:30 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:30.356391 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be0f0-b472-4831-a0f3-ae7bc84595f0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:30.369649 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be0f0-b472-4831-a0f3-ae7bc84595f0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:30.377530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152264fd-f314-42d6-996d-7f7c0018f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:30.378741 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152264fd-f314-42d6-996d-7f7c0018f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.379457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152264fd-f314-42d6-996d-7f7c0018f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.379961 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152264fd-f314-42d6-996d-7f7c0018f4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.381389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152264fd-f314-42d6-996d-7f7c0018f4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:30.384944 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152264fd-f314-42d6-996d-7f7c0018f4a4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:30.401220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1358/2733] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:30.409039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0249cf-da00-48ab-b8b5-5e5122cfde0b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:30.424708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0249cf-da00-48ab-b8b5-5e5122cfde0b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:30.437599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768747-6ed8-4563-83e7-d2d5b378e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:30.437599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768747-6ed8-4563-83e7-d2d5b378e28f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.437599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768747-6ed8-4563-83e7-d2d5b378e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.438997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152264fd-f314-42d6-996d-7f7c0018f4a4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:30.439607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768747-6ed8-4563-83e7-d2d5b378e28f admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.441226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-152264fd-f314-42d6-996d-7f7c0018f4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:30.443163 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd768747-6ed8-4563-83e7-d2d5b378e28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:30.446403 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd768747-6ed8-4563-83e7-d2d5b378e28f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:30.463748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152264fd-f314-42d6-996d-7f7c0018f4a4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:30.471108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1376/2734] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:30.479507 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768747-6ed8-4563-83e7-d2d5b378e28f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:30.487019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:30.488099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.488592 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.489107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] PATH_INFO: `/v3/projects/5e80aabf0f764f8c9b8ac402a77a62d1` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.490897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e80aabf0f764f8c9b8ac402a77a62d1)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:30.492903 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:30.495259 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768747-6ed8-4563-83e7-d2d5b378e28f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:30.502847 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf238ee-60a5-48f4-a434-03ed65af802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:30.503545 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf238ee-60a5-48f4-a434-03ed65af802d admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.503832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf238ee-60a5-48f4-a434-03ed65af802d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.504097 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf238ee-60a5-48f4-a434-03ed65af802d admin admin] PATH_INFO: `/v3/projects/4978ed505af74df5871f9e6c5256241c/users/380d2aa1757e46f680e54b56498fe63a/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.526373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf238ee-60a5-48f4-a434-03ed65af802d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4978ed505af74df5871f9e6c5256241c, user_id=380d2aa1757e46f680e54b56498fe63a, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:30.529439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf238ee-60a5-48f4-a434-03ed65af802d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:30.551800 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1377/2735] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:30 2022] PUT /identity/v3/projects/4978ed505af74df5871f9e6c5256241c/users/380d2aa1757e46f680e54b56498fe63a/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:30.572739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdefd7-1bec-40ce-9a17-074343f9299d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.573089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdefd7-1bec-40ce-9a17-074343f9299d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.573404 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdefd7-1bec-40ce-9a17-074343f9299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.575096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e80aabf0f764f8c9b8ac402a77a62d1', 'request_id': 'req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:30.589985 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e80aabf0f764f8c9b8ac402a77a62d1', 'request_id': 'req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:30.604648 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e80aabf0f764f8c9b8ac402a77a62d1', 'request_id': 'req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:30.628170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] The token cache is being invalidate because project 5e80aabf0f764f8c9b8ac402a77a62d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:30.629018 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:30.630035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ea86031-ecfc-4a97-b3bb-f123f0fd699b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:30.631748 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1359/2736] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:30 2022] DELETE /identity/v3/projects/5e80aabf0f764f8c9b8ac402a77a62d1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:43:30.632607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-50fdefd7-1bec-40ce-9a17-074343f9299d None None] MFA Rules not processed for user `380d2aa1757e46f680e54b56498fe63a`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:30.634945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-50fdefd7-1bec-40ce-9a17-074343f9299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:30.641578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8881-12c1-425e-aacf-be982320f569 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.643636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8881-12c1-425e-aacf-be982320f569 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.644094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8881-12c1-425e-aacf-be982320f569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.676358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-400b8881-12c1-425e-aacf-be982320f569 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:30.678872 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-400b8881-12c1-425e-aacf-be982320f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:30.688067 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:30.761182 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1378/2737] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:30.775172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdefd7-1bec-40ce-9a17-074343f9299d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:30.776667 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-50fdefd7-1bec-40ce-9a17-074343f9299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:30.778347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1360/2738] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:30.790842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd621f-1d44-4a44-9481-fdb6ad32bf38 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.791446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd621f-1d44-4a44-9481-fdb6ad32bf38 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.791717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd621f-1d44-4a44-9481-fdb6ad32bf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.815898 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-69dd621f-1d44-4a44-9481-fdb6ad32bf38 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:30.817210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-69dd621f-1d44-4a44-9481-fdb6ad32bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:30.825639 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:30.833881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1361/2739] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:30.841024 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd621f-1d44-4a44-9481-fdb6ad32bf38 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:30.861981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd621f-1d44-4a44-9481-fdb6ad32bf38 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:30.869764 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6def-d706-41d7-a3c4-21407f12ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:30.870481 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6def-d706-41d7-a3c4-21407f12ecfb admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.870836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6def-d706-41d7-a3c4-21407f12ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.871141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6def-d706-41d7-a3c4-21407f12ecfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.872368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f6def-d706-41d7-a3c4-21407f12ecfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:43:30.872368 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f6def-d706-41d7-a3c4-21407f12ecfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:30.875811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f6def-d706-41d7-a3c4-21407f12ecfb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:30.882935 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdefd7-1bec-40ce-9a17-074343f9299d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:30.891025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1379b-b848-4e4b-acfe-7dbe80f3ad36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:30.891725 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1379b-b848-4e4b-acfe-7dbe80f3ad36 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.892050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1379b-b848-4e4b-acfe-7dbe80f3ad36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.892315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1379b-b848-4e4b-acfe-7dbe80f3ad36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.895890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1362/2740] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:43:30.901936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6def-d706-41d7-a3c4-21407f12ecfb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:30.909754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1379b-b848-4e4b-acfe-7dbe80f3ad36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:30.911273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1379b-b848-4e4b-acfe-7dbe80f3ad36 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:30.913591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6def-d706-41d7-a3c4-21407f12ecfb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:30.918629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37715bcd-a339-41a4-9ce1-4267fc51ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:30.919271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37715bcd-a339-41a4-9ce1-4267fc51ba77 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:30.919548 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37715bcd-a339-41a4-9ce1-4267fc51ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:30.919849 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37715bcd-a339-41a4-9ce1-4267fc51ba77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:30.920503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37715bcd-a339-41a4-9ce1-4267fc51ba77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:30.921132 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1379/2741] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:43:30.923615 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37715bcd-a339-41a4-9ce1-4267fc51ba77 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:30.959244 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1363/2742] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:30 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:30.960582 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1379b-b848-4e4b-acfe-7dbe80f3ad36 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:30.978915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1379b-b848-4e4b-acfe-7dbe80f3ad36 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:31.075764 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95fd1-8331-4f90-bd73-86c3d86f8685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:31.076587 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95fd1-8331-4f90-bd73-86c3d86f8685 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:31.077426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95fd1-8331-4f90-bd73-86c3d86f8685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:31.077713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95fd1-8331-4f90-bd73-86c3d86f8685 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:31.078524 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd95fd1-8331-4f90-bd73-86c3d86f8685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:31.080832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd95fd1-8331-4f90-bd73-86c3d86f8685 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:31.112715 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1380/2743] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:30 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:31.119751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37715bcd-a339-41a4-9ce1-4267fc51ba77 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:31.143488 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37715bcd-a339-41a4-9ce1-4267fc51ba77 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:31.149777 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3006ca-f9ae-4623-8ab4-9a493fed40c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:31.150980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3006ca-f9ae-4623-8ab4-9a493fed40c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:31.151891 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3006ca-f9ae-4623-8ab4-9a493fed40c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:31.152241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3006ca-f9ae-4623-8ab4-9a493fed40c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:31.153197 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3006ca-f9ae-4623-8ab4-9a493fed40c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:31.155459 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3006ca-f9ae-4623-8ab4-9a493fed40c0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:31.171073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1364/2744] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:43:31.176626 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95fd1-8331-4f90-bd73-86c3d86f8685 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:31.197392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95fd1-8331-4f90-bd73-86c3d86f8685 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:31.208284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480ce6b-7660-41d7-a11c-087fd26371eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:31.208926 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480ce6b-7660-41d7-a11c-087fd26371eb admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:31.209199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480ce6b-7660-41d7-a11c-087fd26371eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:31.209482 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480ce6b-7660-41d7-a11c-087fd26371eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:31.210184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480ce6b-7660-41d7-a11c-087fd26371eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:31.212187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480ce6b-7660-41d7-a11c-087fd26371eb admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:31.227420 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1381/2745] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:31.232156 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3006ca-f9ae-4623-8ab4-9a493fed40c0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:31.244674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3006ca-f9ae-4623-8ab4-9a493fed40c0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:31.252071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dbcd9-2de2-473d-a154-66a14e883724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:31.253165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dbcd9-2de2-473d-a154-66a14e883724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:31.253495 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dbcd9-2de2-473d-a154-66a14e883724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:31.253922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dbcd9-2de2-473d-a154-66a14e883724 admin admin] PATH_INFO: `/v3/projects/27a7ba12af984afda9b6d9ef80d4434f/users/abda0f0b14fe4e5f8a8af0525c2e0e62/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:31.282929 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dbcd9-2de2-473d-a154-66a14e883724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a7ba12af984afda9b6d9ef80d4434f, user_id=abda0f0b14fe4e5f8a8af0525c2e0e62, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:31.286425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dbcd9-2de2-473d-a154-66a14e883724 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:31.316595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1365/2746] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:31 2022] PUT /identity/v3/projects/27a7ba12af984afda9b6d9ef80d4434f/users/abda0f0b14fe4e5f8a8af0525c2e0e62/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:43:31.326018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73b16-a634-464c-b292-c59821756726 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:31.326817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73b16-a634-464c-b292-c59821756726 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:31.327146 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73b16-a634-464c-b292-c59821756726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:31.368564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-dad73b16-a634-464c-b292-c59821756726 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:31.369956 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dad73b16-a634-464c-b292-c59821756726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:31.510165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1382/2747] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:31.532733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dbcd9-2de2-473d-a154-66a14e883724 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:31.536926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4c6dbcd9-2de2-473d-a154-66a14e883724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:31.740354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dbcd9-2de2-473d-a154-66a14e883724 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:31.747030 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e7a5a-77c3-45aa-82d7-3099a6c404c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:31.748028 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7a5a-77c3-45aa-82d7-3099a6c404c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:31.749439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7a5a-77c3-45aa-82d7-3099a6c404c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:31.749439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7a5a-77c3-45aa-82d7-3099a6c404c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:31.767566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e7a5a-77c3-45aa-82d7-3099a6c404c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:31.769517 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e7a5a-77c3-45aa-82d7-3099a6c404c6 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:31.785324 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1366/2748] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:38.907358 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad73b16-a634-464c-b292-c59821756726 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:38.909243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dad73b16-a634-464c-b292-c59821756726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:39.073383 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:39.151734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad73b16-a634-464c-b292-c59821756726 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:39.159418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f234f1f-cb6f-4139-995e-85cfcf23decc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:39.161581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f234f1f-cb6f-4139-995e-85cfcf23decc service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:39.161866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f234f1f-cb6f-4139-995e-85cfcf23decc service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:39.162137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f234f1f-cb6f-4139-995e-85cfcf23decc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:39.164316 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0f234f1f-cb6f-4139-995e-85cfcf23decc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:39.180121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f234f1f-cb6f-4139-995e-85cfcf23decc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:39.181833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f234f1f-cb6f-4139-995e-85cfcf23decc service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:39.222713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1383/2749] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:40.259278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92e6e-1e6f-4f5c-ac1d-537e545babc0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:40.260989 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92e6e-1e6f-4f5c-ac1d-537e545babc0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:40.261923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92e6e-1e6f-4f5c-ac1d-537e545babc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:40.308853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97590a-853c-4edd-a318-52ba9c419507 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:40.309617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97590a-853c-4edd-a318-52ba9c419507 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:40.309617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97590a-853c-4edd-a318-52ba9c419507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:40.355947 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6c97590a-853c-4edd-a318-52ba9c419507 None None] MFA Rules not processed for user `abda0f0b14fe4e5f8a8af0525c2e0e62`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:40.357635 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6c97590a-853c-4edd-a318-52ba9c419507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:40.381338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b6f92e6e-1e6f-4f5c-ac1d-537e545babc0 None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:40.383568 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b6f92e6e-1e6f-4f5c-ac1d-537e545babc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:40.393722 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:40.475456 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1384/2750] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:40.481902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97590a-853c-4edd-a318-52ba9c419507 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:40.496795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97590a-853c-4edd-a318-52ba9c419507 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:40.503232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40871da6-a453-491a-b7f4-762895128d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:40.503531 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40871da6-a453-491a-b7f4-762895128d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:40.503746 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40871da6-a453-491a-b7f4-762895128d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:40.504190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40871da6-a453-491a-b7f4-762895128d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:40.505017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40871da6-a453-491a-b7f4-762895128d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:40.507407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40871da6-a453-491a-b7f4-762895128d61 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:40.511327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1367/2751] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:43:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:40.542645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1385/2752] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:40 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:40.545176 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f92e6e-1e6f-4f5c-ac1d-537e545babc0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:40.548257 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b6f92e6e-1e6f-4f5c-ac1d-537e545babc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:40.549074 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40871da6-a453-491a-b7f4-762895128d61 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:40.642222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40871da6-a453-491a-b7f4-762895128d61 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:40.651903 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3adbf7-7439-40b7-b3a6-82adb452e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:40.652976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3adbf7-7439-40b7-b3a6-82adb452e0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:40.653480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3adbf7-7439-40b7-b3a6-82adb452e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:40.653979 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3adbf7-7439-40b7-b3a6-82adb452e0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:40.655399 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3adbf7-7439-40b7-b3a6-82adb452e0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:40.659352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3adbf7-7439-40b7-b3a6-82adb452e0a8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:40.702712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1386/2753] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:40 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:43:40.707271 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3adbf7-7439-40b7-b3a6-82adb452e0a8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:40.726070 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3adbf7-7439-40b7-b3a6-82adb452e0a8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:40.726636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f92e6e-1e6f-4f5c-ac1d-537e545babc0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:40.735352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c33a82-1c4f-40aa-a609-0e1265258cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:40.736612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c33a82-1c4f-40aa-a609-0e1265258cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:40.737212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c33a82-1c4f-40aa-a609-0e1265258cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:40.737521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c33a82-1c4f-40aa-a609-0e1265258cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:40.738319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c33a82-1c4f-40aa-a609-0e1265258cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:40.740414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c33a82-1c4f-40aa-a609-0e1265258cb5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:40.775101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1387/2754] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:40.780627 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c33a82-1c4f-40aa-a609-0e1265258cb5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:40.793946 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c33a82-1c4f-40aa-a609-0e1265258cb5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:40.801882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba408dea-7d72-4e2b-92ab-a99adbe2536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:40.802778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba408dea-7d72-4e2b-92ab-a99adbe2536e admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:40.804660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba408dea-7d72-4e2b-92ab-a99adbe2536e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:40.805165 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba408dea-7d72-4e2b-92ab-a99adbe2536e admin admin] PATH_INFO: `/v3/projects/d288c60e0f0f4e629070ff205837a630/users/f366723cdbf94905a2b8cf3cb825effb/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:40.837440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70a4a-168a-40b5-b557-4a4e8aa33c9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:40.838388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70a4a-168a-40b5-b557-4a4e8aa33c9a service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:40.839141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70a4a-168a-40b5-b557-4a4e8aa33c9a service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:40.839714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70a4a-168a-40b5-b557-4a4e8aa33c9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:40.842129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba408dea-7d72-4e2b-92ab-a99adbe2536e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d288c60e0f0f4e629070ff205837a630, user_id=f366723cdbf94905a2b8cf3cb825effb, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:40.848752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba408dea-7d72-4e2b-92ab-a99adbe2536e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:40.865112 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:40.882261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1388/2755] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:40 2022] PUT /identity/v3/projects/d288c60e0f0f4e629070ff205837a630/users/f366723cdbf94905a2b8cf3cb825effb/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:40.887247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba408dea-7d72-4e2b-92ab-a99adbe2536e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:40.900297 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:40.950407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de70a4a-168a-40b5-b557-4a4e8aa33c9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:40.953115 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de70a4a-168a-40b5-b557-4a4e8aa33c9a service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:40.965665 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1368/2756] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:43:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:41.021071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba408dea-7d72-4e2b-92ab-a99adbe2536e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:41.043846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f8289-aa70-4998-b930-df17240e66d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:41.044415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f8289-aa70-4998-b930-df17240e66d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:41.044694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f8289-aa70-4998-b930-df17240e66d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:41.044970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f8289-aa70-4998-b930-df17240e66d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:41.045874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f8289-aa70-4998-b930-df17240e66d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:41.048078 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f8289-aa70-4998-b930-df17240e66d5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:41.067225 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1389/2757] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:43:41.069497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70a4a-168a-40b5-b557-4a4e8aa33c9a service swift] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:41.088219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70a4a-168a-40b5-b557-4a4e8aa33c9a service swift] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:41.094778 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6eeaca-4675-49d9-af8c-b0f853a02675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:41.099927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eeaca-4675-49d9-af8c-b0f853a02675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:41.100799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eeaca-4675-49d9-af8c-b0f853a02675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:41.100799 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eeaca-4675-49d9-af8c-b0f853a02675 admin admin] PATH_INFO: `/v3/projects/d288c60e0f0f4e629070ff205837a630/users/f366723cdbf94905a2b8cf3cb825effb/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:41.103678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eeaca-4675-49d9-af8c-b0f853a02675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d288c60e0f0f4e629070ff205837a630, user_id=f366723cdbf94905a2b8cf3cb825effb, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:41.111560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eeaca-4675-49d9-af8c-b0f853a02675 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:41.143241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1369/2758] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:41 2022] PUT /identity/v3/projects/d288c60e0f0f4e629070ff205837a630/users/f366723cdbf94905a2b8cf3cb825effb/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:41.991267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a2d27-fe5a-43c5-ac7e-440282935581 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:41.991839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a2d27-fe5a-43c5-ac7e-440282935581 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:41.992265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a2d27-fe5a-43c5-ac7e-440282935581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:42.027447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9f6a2d27-fe5a-43c5-ac7e-440282935581 None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:42.030518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9f6a2d27-fe5a-43c5-ac7e-440282935581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:42.193920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1390/2759] 10.222.0.78 () {58 vars in 967 bytes} [Wed Aug 24 03:43:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:42.235927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6eeaca-4675-49d9-af8c-b0f853a02675 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:42.481318 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6eeaca-4675-49d9-af8c-b0f853a02675 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:42.494689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25087afc-9e2e-44f4-8796-7b355f6d416a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:42.495719 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25087afc-9e2e-44f4-8796-7b355f6d416a service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:42.496192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25087afc-9e2e-44f4-8796-7b355f6d416a service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:42.496664 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25087afc-9e2e-44f4-8796-7b355f6d416a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:42.516804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25087afc-9e2e-44f4-8796-7b355f6d416a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:42.520674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25087afc-9e2e-44f4-8796-7b355f6d416a service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:42.537941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1370/2760] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:43:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:43.124249 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeee32-1f82-4e11-a934-e5888ec274c3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:43.125452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeee32-1f82-4e11-a934-e5888ec274c3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:43.126107 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeee32-1f82-4e11-a934-e5888ec274c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:43.153598 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a3eeee32-1f82-4e11-a934-e5888ec274c3 None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:43.155466 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a3eeee32-1f82-4e11-a934-e5888ec274c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:43.167574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1391/2761] 10.222.0.78 () {58 vars in 1009 bytes} [Wed Aug 24 03:43:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:43.187979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25087afc-9e2e-44f4-8796-7b355f6d416a service swift] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:43.205982 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25087afc-9e2e-44f4-8796-7b355f6d416a service swift] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:43.224256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd1c6-a90d-429a-9d40-2a29cd597c09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:43.225265 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd1c6-a90d-429a-9d40-2a29cd597c09 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:43.225864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd1c6-a90d-429a-9d40-2a29cd597c09 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:43.226283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd1c6-a90d-429a-9d40-2a29cd597c09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:43.248636 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd1c6-a90d-429a-9d40-2a29cd597c09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:43.252033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd1c6-a90d-429a-9d40-2a29cd597c09 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:43.271045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1371/2762] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:44.134431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281e79a-c66d-495a-8c22-79a2361ba35c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:44.135898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281e79a-c66d-495a-8c22-79a2361ba35c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:44.135898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281e79a-c66d-495a-8c22-79a2361ba35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:44.175308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-4281e79a-c66d-495a-8c22-79a2361ba35c None None] MFA Rules not processed for user `f988895119ea43448a4a0f4e4a0274bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:44.177889 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4281e79a-c66d-495a-8c22-79a2361ba35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:44.192284 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1392/2763] 10.222.0.78 () {58 vars in 967 bytes} [Wed Aug 24 03:43:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:44.222811 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd1c6-a90d-429a-9d40-2a29cd597c09 service swift] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:44.257155 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd1c6-a90d-429a-9d40-2a29cd597c09 service swift] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:44.276884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b7a01-7d3d-43f2-bb4c-b9a844f655f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72dc03535044d6a97a953256839d413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:44.278859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b7a01-7d3d-43f2-bb4c-b9a844f655f9 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:44.281358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b7a01-7d3d-43f2-bb4c-b9a844f655f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:44.283347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b7a01-7d3d-43f2-bb4c-b9a844f655f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:44.315237 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b7a01-7d3d-43f2-bb4c-b9a844f655f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:44.319206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b7a01-7d3d-43f2-bb4c-b9a844f655f9 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:44.354325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1372/2764] 10.222.0.78 () {60 vars in 1384 bytes} [Wed Aug 24 03:43:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:43:47.907331 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281e79a-c66d-495a-8c22-79a2361ba35c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:47.909765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4281e79a-c66d-495a-8c22-79a2361ba35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:48.020062 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281e79a-c66d-495a-8c22-79a2361ba35c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:48.025505 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:48.026340 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:48.026705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:48.027149 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] PATH_INFO: `/v3/users/059590563d49468f90913a148b541ed0` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:48.028551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] RBAC: Authorizing `identity:delete_user(user_id=059590563d49468f90913a148b541ed0)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:48.030778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:48.106350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:48.175845 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059590563d49468f90913a148b541ed0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:48.182712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059590563d49468f90913a148b541ed0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:48.217257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059590563d49468f90913a148b541ed0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:48.242228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059590563d49468f90913a148b541ed0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:48.263483 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059590563d49468f90913a148b541ed0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:48.273325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1393/2765] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:47 2022] DELETE /identity/v3/users/059590563d49468f90913a148b541ed0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:43:48.281363 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b2fb8-93f2-4852-9de6-895e1b082d20 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:48.282979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b2fb8-93f2-4852-9de6-895e1b082d20 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:48.283769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b2fb8-93f2-4852-9de6-895e1b082d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:48.319086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3f3b2fb8-93f2-4852-9de6-895e1b082d20 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:48.321232 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3f3b2fb8-93f2-4852-9de6-895e1b082d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:48.534774 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1373/2766] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:48.539212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:48.541557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:48.789314 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6da3e2-c23f-495c-ab10-23546664202b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:48.809612 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5f6a1-cdfe-49fb-923a-1b272ecda21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:48.810646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5f6a1-cdfe-49fb-923a-1b272ecda21e service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:48.811510 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5f6a1-cdfe-49fb-923a-1b272ecda21e service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:48.811988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5f6a1-cdfe-49fb-923a-1b272ecda21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:48.857051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5f6a1-cdfe-49fb-923a-1b272ecda21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:48.857414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5f6a1-cdfe-49fb-923a-1b272ecda21e service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:48.870796 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1394/2767] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:49.306643 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b2fb8-93f2-4852-9de6-895e1b082d20 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:49.310026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3f3b2fb8-93f2-4852-9de6-895e1b082d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:49.353834 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb24e4-ab4c-4316-bae1-5608dc5aa0e4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:49.355434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb24e4-ab4c-4316-bae1-5608dc5aa0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:49.356173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb24e4-ab4c-4316-bae1-5608dc5aa0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:49.360537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b2fb8-93f2-4852-9de6-895e1b082d20 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:49.384467 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:49.385804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:49.386295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:49.387438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] PATH_INFO: `/v3/projects/68fbe2908c054860a8424803fc82ca8d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:49.390779 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fbe2908c054860a8424803fc82ca8d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:49.396731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:49.422803 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9afb24e4-ab4c-4316-bae1-5608dc5aa0e4 None None] MFA Rules not processed for user `f366723cdbf94905a2b8cf3cb825effb`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:49.424076 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9afb24e4-ab4c-4316-bae1-5608dc5aa0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:49.449221 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:49.530222 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fbe2908c054860a8424803fc82ca8d', 'request_id': 'req-719fe598-9aa1-4b2f-b3dc-ccab159a0440'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:49.539482 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fbe2908c054860a8424803fc82ca8d', 'request_id': 'req-719fe598-9aa1-4b2f-b3dc-ccab159a0440'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:49.547845 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fbe2908c054860a8424803fc82ca8d', 'request_id': 'req-719fe598-9aa1-4b2f-b3dc-ccab159a0440'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:49.566174 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1395/2768] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:49.575724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] The token cache is being invalidate because project 68fbe2908c054860a8424803fc82ca8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:43:49.576519 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:49.577649 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-719fe598-9aa1-4b2f-b3dc-ccab159a0440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:49.580249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1374/2769] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:43:49 2022] DELETE /identity/v3/projects/68fbe2908c054860a8424803fc82ca8d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:43:49.588576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb24e4-ab4c-4316-bae1-5608dc5aa0e4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:49.593220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9afb24e4-ab4c-4316-bae1-5608dc5aa0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:49.747754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:49.858119 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb24e4-ab4c-4316-bae1-5608dc5aa0e4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:50.019888 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:50.020670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:50.021040 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:50.021387 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:50.023473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:50.110904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:50.113731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:50.129489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1396/2770] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:51.950837 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600414e-1175-4fb4-a12d-7c1b0cba0863 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:51.951657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600414e-1175-4fb4-a12d-7c1b0cba0863 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:51.952249 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600414e-1175-4fb4-a12d-7c1b0cba0863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:51.993095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2600414e-1175-4fb4-a12d-7c1b0cba0863 None None] MFA Rules not processed for user `abda0f0b14fe4e5f8a8af0525c2e0e62`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:51.995646 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2600414e-1175-4fb4-a12d-7c1b0cba0863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:52.021935 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1375/2771] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:43:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:57.972476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:57.974002 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:58.057373 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c1dc3-cfd6-46ed-b45f-bd1dc6962c1a service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:58.061277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e98406-2cfb-464e-bcd8-e0f95b47a929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:58.061944 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98406-2cfb-464e-bcd8-e0f95b47a929 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:58.062194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98406-2cfb-464e-bcd8-e0f95b47a929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:58.062468 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98406-2cfb-464e-bcd8-e0f95b47a929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:58.064327 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-92e98406-2cfb-464e-bcd8-e0f95b47a929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:58.087038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:58.152204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e98406-2cfb-464e-bcd8-e0f95b47a929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:58.153686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e98406-2cfb-464e-bcd8-e0f95b47a929 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:58.165709 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1397/2772] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:01.983643 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:02.920079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600414e-1175-4fb4-a12d-7c1b0cba0863 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:02.922960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2600414e-1175-4fb4-a12d-7c1b0cba0863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:02.948895 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600414e-1175-4fb4-a12d-7c1b0cba0863 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:02.958987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:02.960629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:02.960750 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:02.961306 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] PATH_INFO: `/v3/users/45285b561f424fde9297724c6768250d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:02.984312 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45285b561f424fde9297724c6768250d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:02.988055 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:03.064282 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45285b561f424fde9297724c6768250d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.065349 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45285b561f424fde9297724c6768250d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.066384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45285b561f424fde9297724c6768250d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.091263 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45285b561f424fde9297724c6768250d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.105697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-33cbaa29-882b-4158-8cd4-4084775fc2f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45285b561f424fde9297724c6768250d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.127157 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1376/2773] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:02 2022] DELETE /identity/v3/users/45285b561f424fde9297724c6768250d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:03.371344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e98406-2cfb-464e-bcd8-e0f95b47a929 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:03.387645 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e98406-2cfb-464e-bcd8-e0f95b47a929 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:03.475743 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:03.476813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:03.477274 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:03.477718 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] PATH_INFO: `/v3/projects/70bebe773822488a90a1258551c3f09b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:03.501521 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70bebe773822488a90a1258551c3f09b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:03.505285 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:03.582035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70bebe773822488a90a1258551c3f09b', 'request_id': 'req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.594411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70bebe773822488a90a1258551c3f09b', 'request_id': 'req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.603981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70bebe773822488a90a1258551c3f09b', 'request_id': 'req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.620687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] The token cache is being invalidate because project 70bebe773822488a90a1258551c3f09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:03.620687 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.621076 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d998a54b-7d5f-41bf-a9d6-718f35c6fed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:03.622628 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1398/2774] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:03 2022] DELETE /identity/v3/projects/70bebe773822488a90a1258551c3f09b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:03.628335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae823b14-375d-46af-a995-a90e0fb26fe5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:03.629532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae823b14-375d-46af-a995-a90e0fb26fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:03.630100 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae823b14-375d-46af-a995-a90e0fb26fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:03.657075 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ae823b14-375d-46af-a995-a90e0fb26fe5 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:03.658460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ae823b14-375d-46af-a995-a90e0fb26fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:03.743026 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1377/2775] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:44:03.753541 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe373e5e-36c8-48f7-943e-9b6a07e0eefd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:03.753873 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe373e5e-36c8-48f7-943e-9b6a07e0eefd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:03.754189 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe373e5e-36c8-48f7-943e-9b6a07e0eefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:03.776033 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fe373e5e-36c8-48f7-943e-9b6a07e0eefd None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:03.777554 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fe373e5e-36c8-48f7-943e-9b6a07e0eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:03.789476 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1399/2776] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:44:03.794277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae823b14-375d-46af-a995-a90e0fb26fe5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:03.806029 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae823b14-375d-46af-a995-a90e0fb26fe5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:03.811072 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6590ac-4126-4598-8025-7c48dfe7f00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:03.811724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6590ac-4126-4598-8025-7c48dfe7f00a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:03.812073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6590ac-4126-4598-8025-7c48dfe7f00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:03.812348 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6590ac-4126-4598-8025-7c48dfe7f00a admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:03.813025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6590ac-4126-4598-8025-7c48dfe7f00a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:44:03.813025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6590ac-4126-4598-8025-7c48dfe7f00a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:03.815800 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6590ac-4126-4598-8025-7c48dfe7f00a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:03.828622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1378/2777] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:44:03.836678 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe373e5e-36c8-48f7-943e-9b6a07e0eefd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:03.846686 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe373e5e-36c8-48f7-943e-9b6a07e0eefd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:03.852187 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abcb2e-94d9-4aa1-b14d-03ac6f341c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:03.852824 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abcb2e-94d9-4aa1-b14d-03ac6f341c65 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:03.853098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abcb2e-94d9-4aa1-b14d-03ac6f341c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:03.853367 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abcb2e-94d9-4aa1-b14d-03ac6f341c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:03.854034 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abcb2e-94d9-4aa1-b14d-03ac6f341c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:03.856029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abcb2e-94d9-4aa1-b14d-03ac6f341c65 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:03.889909 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1400/2778] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:03 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:03.895685 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6590ac-4126-4598-8025-7c48dfe7f00a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:03.908120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6590ac-4126-4598-8025-7c48dfe7f00a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:03.967571 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:03.988048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981445-8c4c-4c45-af9c-e4b1c2783094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:03.989080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981445-8c4c-4c45-af9c-e4b1c2783094 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:03.989080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981445-8c4c-4c45-af9c-e4b1c2783094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:03.989433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981445-8c4c-4c45-af9c-e4b1c2783094 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:03.989808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981445-8c4c-4c45-af9c-e4b1c2783094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:03.991948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981445-8c4c-4c45-af9c-e4b1c2783094 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.027162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1379/2779] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:03 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:04.032041 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abcb2e-94d9-4aa1-b14d-03ac6f341c65 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:04.048948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abcb2e-94d9-4aa1-b14d-03ac6f341c65 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:04.054283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e3931-c350-42db-94d7-1388073ebac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:04.055024 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3931-c350-42db-94d7-1388073ebac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.055305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3931-c350-42db-94d7-1388073ebac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.055567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3931-c350-42db-94d7-1388073ebac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.056325 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e3931-c350-42db-94d7-1388073ebac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:04.058176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e3931-c350-42db-94d7-1388073ebac9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.064850 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:04.072257 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1401/2780] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:44:04.079325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981445-8c4c-4c45-af9c-e4b1c2783094 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:04.096425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981445-8c4c-4c45-af9c-e4b1c2783094 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:04.102524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485db5ea-5085-46d1-8fba-5bd0b2af5104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:04.103382 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db5ea-5085-46d1-8fba-5bd0b2af5104 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.103678 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db5ea-5085-46d1-8fba-5bd0b2af5104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.103974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db5ea-5085-46d1-8fba-5bd0b2af5104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.104689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485db5ea-5085-46d1-8fba-5bd0b2af5104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:04.106375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485db5ea-5085-46d1-8fba-5bd0b2af5104 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.121862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1380/2781] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:04.127007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e3931-c350-42db-94d7-1388073ebac9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:04.139773 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e3931-c350-42db-94d7-1388073ebac9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:04.145333 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e96a9-9a2c-4c27-bf7d-0bb0bb0d4dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:04.146027 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e96a9-9a2c-4c27-bf7d-0bb0bb0d4dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.146299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e96a9-9a2c-4c27-bf7d-0bb0bb0d4dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.146574 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e96a9-9a2c-4c27-bf7d-0bb0bb0d4dd1 admin admin] PATH_INFO: `/v3/projects/4fd8e4ad71864dc993d0f50949bcf1e8/users/c106ec4986e7468e9020c0e464c004d3/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.166579 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e96a9-9a2c-4c27-bf7d-0bb0bb0d4dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd8e4ad71864dc993d0f50949bcf1e8, user_id=c106ec4986e7468e9020c0e464c004d3, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:04.172081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e96a9-9a2c-4c27-bf7d-0bb0bb0d4dd1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.192235 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1402/2782] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:04 2022] PUT /identity/v3/projects/4fd8e4ad71864dc993d0f50949bcf1e8/users/c106ec4986e7468e9020c0e464c004d3/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:04.208231 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a26f5-0c56-4222-9a5f-d3a07fbd47b4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.208726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a26f5-0c56-4222-9a5f-d3a07fbd47b4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.209205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a26f5-0c56-4222-9a5f-d3a07fbd47b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.251996 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-628a26f5-0c56-4222-9a5f-d3a07fbd47b4 None None] MFA Rules not processed for user `c106ec4986e7468e9020c0e464c004d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:04.253438 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-628a26f5-0c56-4222-9a5f-d3a07fbd47b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:04.340625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1381/2783] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:04.347867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e96a9-9a2c-4c27-bf7d-0bb0bb0d4dd1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:04.432893 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e96a9-9a2c-4c27-bf7d-0bb0bb0d4dd1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:04.439214 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38815e36-3d3f-478d-90ce-524ef96d8150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:04.439874 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38815e36-3d3f-478d-90ce-524ef96d8150 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.440356 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38815e36-3d3f-478d-90ce-524ef96d8150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.440624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38815e36-3d3f-478d-90ce-524ef96d8150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.441336 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38815e36-3d3f-478d-90ce-524ef96d8150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:04.443323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38815e36-3d3f-478d-90ce-524ef96d8150 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.477217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1403/2784] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:04 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:04.482793 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a26f5-0c56-4222-9a5f-d3a07fbd47b4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:04.502070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a26f5-0c56-4222-9a5f-d3a07fbd47b4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:04.606706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e56ca-daa2-4a40-b723-d28b40d71974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:04.607680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e56ca-daa2-4a40-b723-d28b40d71974 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.608175 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e56ca-daa2-4a40-b723-d28b40d71974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.609019 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e56ca-daa2-4a40-b723-d28b40d71974 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.609808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e56ca-daa2-4a40-b723-d28b40d71974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:04.613241 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e56ca-daa2-4a40-b723-d28b40d71974 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.648466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1382/2785] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:04 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:04.653440 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38815e36-3d3f-478d-90ce-524ef96d8150 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:04.665666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38815e36-3d3f-478d-90ce-524ef96d8150 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:04.672243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a0598-8f01-499d-82c3-001499618a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:04.672945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a0598-8f01-499d-82c3-001499618a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.673190 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a0598-8f01-499d-82c3-001499618a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.673463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a0598-8f01-499d-82c3-001499618a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.674171 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a0598-8f01-499d-82c3-001499618a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:04.675976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a0598-8f01-499d-82c3-001499618a25 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.689997 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1404/2786] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:44:04.694641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e56ca-daa2-4a40-b723-d28b40d71974 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:04.706407 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e56ca-daa2-4a40-b723-d28b40d71974 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:04.717008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f9046-c5b8-47b2-a45a-c5f233aa5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:04.718254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9046-c5b8-47b2-a45a-c5f233aa5fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.719769 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9046-c5b8-47b2-a45a-c5f233aa5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.720393 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9046-c5b8-47b2-a45a-c5f233aa5fb1 admin admin] PATH_INFO: `/v3/projects/ca0961ec399b4c70ab946bd6b50f775b/users/5d4e55de5ffa4398944cb19e33c11900/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.745034 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f9046-c5b8-47b2-a45a-c5f233aa5fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0961ec399b4c70ab946bd6b50f775b, user_id=5d4e55de5ffa4398944cb19e33c11900, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:04.753828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f9046-c5b8-47b2-a45a-c5f233aa5fb1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.778530 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1383/2787] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:04 2022] PUT /identity/v3/projects/ca0961ec399b4c70ab946bd6b50f775b/users/5d4e55de5ffa4398944cb19e33c11900/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:04.783776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a0598-8f01-499d-82c3-001499618a25 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:04.798795 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a0598-8f01-499d-82c3-001499618a25 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:04.883083 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069db0-7005-43cc-9c58-8e3ee2603e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:04.883613 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069db0-7005-43cc-9c58-8e3ee2603e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.883897 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069db0-7005-43cc-9c58-8e3ee2603e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.884162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069db0-7005-43cc-9c58-8e3ee2603e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.884817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6069db0-7005-43cc-9c58-8e3ee2603e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:04.886444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6069db0-7005-43cc-9c58-8e3ee2603e97 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.902557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1405/2788] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:04.907404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f9046-c5b8-47b2-a45a-c5f233aa5fb1 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:04.919149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f9046-c5b8-47b2-a45a-c5f233aa5fb1 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:04.925042 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c797db-b9d1-4ffd-a4cf-0619ff4ad691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:04.926906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c797db-b9d1-4ffd-a4cf-0619ff4ad691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.927181 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c797db-b9d1-4ffd-a4cf-0619ff4ad691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.927471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c797db-b9d1-4ffd-a4cf-0619ff4ad691 admin admin] PATH_INFO: `/v3/projects/ca0961ec399b4c70ab946bd6b50f775b/users/5d4e55de5ffa4398944cb19e33c11900/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:04.929914 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c797db-b9d1-4ffd-a4cf-0619ff4ad691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0961ec399b4c70ab946bd6b50f775b, user_id=5d4e55de5ffa4398944cb19e33c11900, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:04.933513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c797db-b9d1-4ffd-a4cf-0619ff4ad691 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:04.955624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1384/2789] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:04 2022] PUT /identity/v3/projects/ca0961ec399b4c70ab946bd6b50f775b/users/5d4e55de5ffa4398944cb19e33c11900/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:04.967799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168ae9-dee8-42ac-bb16-df64f248e4c2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:04.968161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168ae9-dee8-42ac-bb16-df64f248e4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:04.968444 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168ae9-dee8-42ac-bb16-df64f248e4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:05.004252 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d5168ae9-dee8-42ac-bb16-df64f248e4c2 None None] MFA Rules not processed for user `5d4e55de5ffa4398944cb19e33c11900`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:05.006408 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d5168ae9-dee8-42ac-bb16-df64f248e4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:05.074875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:05.136540 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1406/2790] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:05.149547 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c797db-b9d1-4ffd-a4cf-0619ff4ad691 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:05.152343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-24c797db-b9d1-4ffd-a4cf-0619ff4ad691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:05.171048 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:05.255295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c797db-b9d1-4ffd-a4cf-0619ff4ad691 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:05.260070 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208488e-5591-4f6d-a4bc-20ea94d43bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:05.260842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208488e-5591-4f6d-a4bc-20ea94d43bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:05.261164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208488e-5591-4f6d-a4bc-20ea94d43bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:05.261483 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208488e-5591-4f6d-a4bc-20ea94d43bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:05.279341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208488e-5591-4f6d-a4bc-20ea94d43bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:05.281394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208488e-5591-4f6d-a4bc-20ea94d43bb4 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:05.293124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1385/2791] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:05.396790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5168ae9-dee8-42ac-bb16-df64f248e4c2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:05.408757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5168ae9-dee8-42ac-bb16-df64f248e4c2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:05.414382 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc71569-62e6-4851-8e30-e41d167c9233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:05.415503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc71569-62e6-4851-8e30-e41d167c9233 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:05.416000 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc71569-62e6-4851-8e30-e41d167c9233 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:05.416566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc71569-62e6-4851-8e30-e41d167c9233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:05.529039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc71569-62e6-4851-8e30-e41d167c9233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:05.531881 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc71569-62e6-4851-8e30-e41d167c9233 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:05.549207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1407/2792] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:12.894460 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208488e-5591-4f6d-a4bc-20ea94d43bb4 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:13.001094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208488e-5591-4f6d-a4bc-20ea94d43bb4 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:13.006601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:13.007359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:13.007675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:13.008023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] PATH_INFO: `/v3/users/c106ec4986e7468e9020c0e464c004d3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:13.009537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c106ec4986e7468e9020c0e464c004d3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:13.011629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:13.075591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c106ec4986e7468e9020c0e464c004d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.076313 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c106ec4986e7468e9020c0e464c004d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.076937 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c106ec4986e7468e9020c0e464c004d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.092027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c106ec4986e7468e9020c0e464c004d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.100613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c106ec4986e7468e9020c0e464c004d3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.118209 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1386/2793] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:12 2022] DELETE /identity/v3/users/c106ec4986e7468e9020c0e464c004d3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:13.123438 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f082ce-b9c6-4baa-94b7-133aba2a3339 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:13.124063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f082ce-b9c6-4baa-94b7-133aba2a3339 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:13.124063 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f082ce-b9c6-4baa-94b7-133aba2a3339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:13.145872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-70f082ce-b9c6-4baa-94b7-133aba2a3339 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:13.147178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-70f082ce-b9c6-4baa-94b7-133aba2a3339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:13.223710 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1408/2794] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:13.236700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:13.238974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:13.291762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:13.330997 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50793-99c0-4855-84d4-34b94344477c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:13.338735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8222c-946c-4fa4-8ae0-0412fc944cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:13.339856 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8222c-946c-4fa4-8ae0-0412fc944cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:13.340675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8222c-946c-4fa4-8ae0-0412fc944cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:13.341107 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8222c-946c-4fa4-8ae0-0412fc944cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:13.358696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8222c-946c-4fa4-8ae0-0412fc944cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:13.361439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8222c-946c-4fa4-8ae0-0412fc944cc9 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:13.377091 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1387/2795] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:13.798863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f082ce-b9c6-4baa-94b7-133aba2a3339 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:13.800878 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-70f082ce-b9c6-4baa-94b7-133aba2a3339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:13.815089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f082ce-b9c6-4baa-94b7-133aba2a3339 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:13.820342 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:13.821386 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:13.821659 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:13.822220 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] PATH_INFO: `/v3/projects/4fd8e4ad71864dc993d0f50949bcf1e8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:13.823738 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd8e4ad71864dc993d0f50949bcf1e8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:13.825739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:13.889551 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd8e4ad71864dc993d0f50949bcf1e8', 'request_id': 'req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.900021 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd8e4ad71864dc993d0f50949bcf1e8', 'request_id': 'req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.909202 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd8e4ad71864dc993d0f50949bcf1e8', 'request_id': 'req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.916646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:13.926952 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] The token cache is being invalidate because project 4fd8e4ad71864dc993d0f50949bcf1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:13.929939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.931103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:13.933110 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1409/2796] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:13 2022] DELETE /identity/v3/projects/4fd8e4ad71864dc993d0f50949bcf1e8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:13.937208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8222c-946c-4fa4-8ae0-0412fc944cc9 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:13.947726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8222c-946c-4fa4-8ae0-0412fc944cc9 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:14.017061 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:14.017772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:14.018137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:14.018512 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] PATH_INFO: `/v3/users/5d4e55de5ffa4398944cb19e33c11900` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:14.020318 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4e55de5ffa4398944cb19e33c11900)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:14.022436 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:14.096706 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4e55de5ffa4398944cb19e33c11900'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.097524 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4e55de5ffa4398944cb19e33c11900'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.098245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4e55de5ffa4398944cb19e33c11900'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.112928 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4e55de5ffa4398944cb19e33c11900'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.125292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cbd2a0c5-00ca-4a13-a428-8d311f09c2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4e55de5ffa4398944cb19e33c11900'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.143566 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1388/2797] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:13 2022] DELETE /identity/v3/users/5d4e55de5ffa4398944cb19e33c11900 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:14.499500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:14.501680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:14.519366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6e1f0-2008-4f21-8493-c1f68d5c239e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:14.589167 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:14.589822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:14.590093 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:14.590357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] PATH_INFO: `/v3/projects/ca0961ec399b4c70ab946bd6b50f775b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:14.591604 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0961ec399b4c70ab946bd6b50f775b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:14.594009 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:14.667379 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0961ec399b4c70ab946bd6b50f775b', 'request_id': 'req-6a0fe25e-3755-4227-86b6-48b8b6850a69'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.677514 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0961ec399b4c70ab946bd6b50f775b', 'request_id': 'req-6a0fe25e-3755-4227-86b6-48b8b6850a69'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.686563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0961ec399b4c70ab946bd6b50f775b', 'request_id': 'req-6a0fe25e-3755-4227-86b6-48b8b6850a69'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.704675 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] The token cache is being invalidate because project ca0961ec399b4c70ab946bd6b50f775b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:14.705017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.705921 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a0fe25e-3755-4227-86b6-48b8b6850a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:14.707679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1410/2798] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:14 2022] DELETE /identity/v3/projects/ca0961ec399b4c70ab946bd6b50f775b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:14.712987 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e3ba2-134c-4b76-bc29-fc17bc1a6d25 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:14.713276 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e3ba2-134c-4b76-bc29-fc17bc1a6d25 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:14.713572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e3ba2-134c-4b76-bc29-fc17bc1a6d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:14.736410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-aa6e3ba2-134c-4b76-bc29-fc17bc1a6d25 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:14.737696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aa6e3ba2-134c-4b76-bc29-fc17bc1a6d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:14.800930 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:14.822836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1389/2799] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:14.829827 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbeed6-27f3-429d-8bd4-ecc6bf1d6aee None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:14.830108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbeed6-27f3-429d-8bd4-ecc6bf1d6aee None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:14.830396 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbeed6-27f3-429d-8bd4-ecc6bf1d6aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:14.857272 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-31bbeed6-27f3-429d-8bd4-ecc6bf1d6aee None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:14.858866 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-31bbeed6-27f3-429d-8bd4-ecc6bf1d6aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:14.867774 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1411/2800] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:44:14.873638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e3ba2-134c-4b76-bc29-fc17bc1a6d25 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:14.884220 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e3ba2-134c-4b76-bc29-fc17bc1a6d25 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:14.889379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80215617-1543-4436-8edc-f188694daae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:14.890069 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80215617-1543-4436-8edc-f188694daae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:14.890350 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80215617-1543-4436-8edc-f188694daae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:14.890619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80215617-1543-4436-8edc-f188694daae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:14.891316 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80215617-1543-4436-8edc-f188694daae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:44:14.891619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80215617-1543-4436-8edc-f188694daae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:14.893242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80215617-1543-4436-8edc-f188694daae7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:14.906448 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1390/2801] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:44:14.911961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbeed6-27f3-429d-8bd4-ecc6bf1d6aee None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:14.922025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbeed6-27f3-429d-8bd4-ecc6bf1d6aee None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:14.927426 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814009-be3b-48c0-9df9-733232db906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:14.928044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814009-be3b-48c0-9df9-733232db906f admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:14.928322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814009-be3b-48c0-9df9-733232db906f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:14.928591 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814009-be3b-48c0-9df9-733232db906f admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:14.929556 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b814009-be3b-48c0-9df9-733232db906f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:14.935173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b814009-be3b-48c0-9df9-733232db906f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:14.964460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1412/2802] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:14 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:14.969092 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80215617-1543-4436-8edc-f188694daae7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:14.980381 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80215617-1543-4436-8edc-f188694daae7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.060612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad4965-dd26-49fc-8089-281d0c4d62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.061260 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad4965-dd26-49fc-8089-281d0c4d62ad admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.062007 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad4965-dd26-49fc-8089-281d0c4d62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.062281 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad4965-dd26-49fc-8089-281d0c4d62ad admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.062962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad4965-dd26-49fc-8089-281d0c4d62ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.064936 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad4965-dd26-49fc-8089-281d0c4d62ad admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:15.092097 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1391/2803] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:14 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:44:15.097797 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814009-be3b-48c0-9df9-733232db906f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:15.114570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814009-be3b-48c0-9df9-733232db906f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.121512 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ffb03-15e9-41fb-a1a2-d29df2851e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.122308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffb03-15e9-41fb-a1a2-d29df2851e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.122642 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffb03-15e9-41fb-a1a2-d29df2851e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.123133 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffb03-15e9-41fb-a1a2-d29df2851e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.124092 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ffb03-15e9-41fb-a1a2-d29df2851e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.126644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ffb03-15e9-41fb-a1a2-d29df2851e95 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:15.141290 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1413/2804] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:44:15.146546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad4965-dd26-49fc-8089-281d0c4d62ad admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:15.163733 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad4965-dd26-49fc-8089-281d0c4d62ad admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.170585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ef7b7-6682-4e08-bf1f-e26012e31b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.173897 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ef7b7-6682-4e08-bf1f-e26012e31b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.174170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ef7b7-6682-4e08-bf1f-e26012e31b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.174417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ef7b7-6682-4e08-bf1f-e26012e31b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.175210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ef7b7-6682-4e08-bf1f-e26012e31b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.176981 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ef7b7-6682-4e08-bf1f-e26012e31b2b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:15.191661 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1392/2805] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:15.196656 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ffb03-15e9-41fb-a1a2-d29df2851e95 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:15.209154 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ffb03-15e9-41fb-a1a2-d29df2851e95 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.215273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e9d0-c7db-45b0-99ac-282f238b5ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.215990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e9d0-c7db-45b0-99ac-282f238b5ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.216338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e9d0-c7db-45b0-99ac-282f238b5ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.216794 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e9d0-c7db-45b0-99ac-282f238b5ad6 admin admin] PATH_INFO: `/v3/projects/69a94b3a00754d66b47dcc79dd2b6242/users/9c334514e1d94aef8307c59d779c9d36/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.244570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92e9d0-c7db-45b0-99ac-282f238b5ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a94b3a00754d66b47dcc79dd2b6242, user_id=9c334514e1d94aef8307c59d779c9d36, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.250025 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92e9d0-c7db-45b0-99ac-282f238b5ad6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:15.272822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1414/2806] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:15 2022] PUT /identity/v3/projects/69a94b3a00754d66b47dcc79dd2b6242/users/9c334514e1d94aef8307c59d779c9d36/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:15.292630 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43800-2322-4e7b-8ada-8775b9d42396 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.293121 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43800-2322-4e7b-8ada-8775b9d42396 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.293606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43800-2322-4e7b-8ada-8775b9d42396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.331242 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cde43800-2322-4e7b-8ada-8775b9d42396 None None] MFA Rules not processed for user `9c334514e1d94aef8307c59d779c9d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:15.332518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cde43800-2322-4e7b-8ada-8775b9d42396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:15.424385 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1393/2807] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:15.431462 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e9d0-c7db-45b0-99ac-282f238b5ad6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:15.458080 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:15.513435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e9d0-c7db-45b0-99ac-282f238b5ad6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.521195 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86a867-937d-448d-baba-16612535824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.522212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86a867-937d-448d-baba-16612535824c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.522712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86a867-937d-448d-baba-16612535824c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.523232 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86a867-937d-448d-baba-16612535824c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.524344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86a867-937d-448d-baba-16612535824c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.527816 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86a867-937d-448d-baba-16612535824c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:15.571439 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1415/2808] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:15 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:44:15.576526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43800-2322-4e7b-8ada-8775b9d42396 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:15.595621 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43800-2322-4e7b-8ada-8775b9d42396 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.652139 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:15.669829 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712b168-d6d8-4520-a694-8929e49d1978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.670616 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712b168-d6d8-4520-a694-8929e49d1978 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.671609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712b168-d6d8-4520-a694-8929e49d1978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.671609 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712b168-d6d8-4520-a694-8929e49d1978 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.672416 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712b168-d6d8-4520-a694-8929e49d1978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.674696 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712b168-d6d8-4520-a694-8929e49d1978 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:15.703365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1394/2809] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:15 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:15.708739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86a867-937d-448d-baba-16612535824c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:15.725895 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86a867-937d-448d-baba-16612535824c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.733424 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe88ea0-7db2-47e0-a256-5efa3f9d6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.734398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe88ea0-7db2-47e0-a256-5efa3f9d6f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.734839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe88ea0-7db2-47e0-a256-5efa3f9d6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.735251 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe88ea0-7db2-47e0-a256-5efa3f9d6f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.736990 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe88ea0-7db2-47e0-a256-5efa3f9d6f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.738915 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe88ea0-7db2-47e0-a256-5efa3f9d6f91 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:15.757846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1416/2810] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:15.762986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712b168-d6d8-4520-a694-8929e49d1978 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:15.779163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712b168-d6d8-4520-a694-8929e49d1978 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.786999 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d606a5f-ea9c-4148-ae22-bd89d17631e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.788011 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d606a5f-ea9c-4148-ae22-bd89d17631e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.788439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d606a5f-ea9c-4148-ae22-bd89d17631e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.788859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d606a5f-ea9c-4148-ae22-bd89d17631e0 admin admin] PATH_INFO: `/v3/projects/40724628a304413cb7db56dfc02ab909/users/16d44280651149ee9f9506d4ba33dc69/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.815134 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d606a5f-ea9c-4148-ae22-bd89d17631e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40724628a304413cb7db56dfc02ab909, user_id=16d44280651149ee9f9506d4ba33dc69, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.819573 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d606a5f-ea9c-4148-ae22-bd89d17631e0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:15.840790 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1395/2811] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:15 2022] PUT /identity/v3/projects/40724628a304413cb7db56dfc02ab909/users/16d44280651149ee9f9506d4ba33dc69/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:15.845976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe88ea0-7db2-47e0-a256-5efa3f9d6f91 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:15.857312 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe88ea0-7db2-47e0-a256-5efa3f9d6f91 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.941871 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41be16-f4e7-4f1a-bca5-797d4bd1a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.942557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41be16-f4e7-4f1a-bca5-797d4bd1a91c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.942870 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41be16-f4e7-4f1a-bca5-797d4bd1a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.943183 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41be16-f4e7-4f1a-bca5-797d4bd1a91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.943867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41be16-f4e7-4f1a-bca5-797d4bd1a91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.945713 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41be16-f4e7-4f1a-bca5-797d4bd1a91c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:15.958050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1417/2812] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:15.963343 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d606a5f-ea9c-4148-ae22-bd89d17631e0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:15.978556 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d606a5f-ea9c-4148-ae22-bd89d17631e0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:15.984437 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c94b-3e5d-411e-9429-888751f6d39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:15.985132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c94b-3e5d-411e-9429-888751f6d39d admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:15.985454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c94b-3e5d-411e-9429-888751f6d39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:15.985669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c94b-3e5d-411e-9429-888751f6d39d admin admin] PATH_INFO: `/v3/projects/40724628a304413cb7db56dfc02ab909/users/16d44280651149ee9f9506d4ba33dc69/roles/e2245cc9e9804bbf8942f7864a05d2e2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:15.987757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1c94b-3e5d-411e-9429-888751f6d39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40724628a304413cb7db56dfc02ab909, user_id=16d44280651149ee9f9506d4ba33dc69, role_id=e2245cc9e9804bbf8942f7864a05d2e2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:15.990463 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1c94b-3e5d-411e-9429-888751f6d39d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:16.004639 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1396/2813] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:15 2022] PUT /identity/v3/projects/40724628a304413cb7db56dfc02ab909/users/16d44280651149ee9f9506d4ba33dc69/roles/e2245cc9e9804bbf8942f7864a05d2e2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:16.021282 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406be8d7-e697-4fef-b6fa-a2318795a036 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:16.021683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406be8d7-e697-4fef-b6fa-a2318795a036 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:16.021869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406be8d7-e697-4fef-b6fa-a2318795a036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:16.057778 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-406be8d7-e697-4fef-b6fa-a2318795a036 None None] MFA Rules not processed for user `16d44280651149ee9f9506d4ba33dc69`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:16.059279 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-406be8d7-e697-4fef-b6fa-a2318795a036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:16.143262 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1418/2814] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:16.156585 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c94b-3e5d-411e-9429-888751f6d39d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:16.159023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0cd1c94b-3e5d-411e-9429-888751f6d39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:16.241440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c94b-3e5d-411e-9429-888751f6d39d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:16.250347 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed688f3-08f6-41da-a193-c6bc4af222a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:16.250959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed688f3-08f6-41da-a193-c6bc4af222a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:16.251552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed688f3-08f6-41da-a193-c6bc4af222a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:16.251906 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed688f3-08f6-41da-a193-c6bc4af222a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:16.270980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed688f3-08f6-41da-a193-c6bc4af222a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:16.273669 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed688f3-08f6-41da-a193-c6bc4af222a2 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:16.292509 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1397/2815] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:44:16.770441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406be8d7-e697-4fef-b6fa-a2318795a036 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:16.791343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:16.857029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406be8d7-e697-4fef-b6fa-a2318795a036 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:16.865023 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:16.866166 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:16.866641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:16.867148 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] PATH_INFO: `/v3/users/9c334514e1d94aef8307c59d779c9d36` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:16.869184 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c334514e1d94aef8307c59d779c9d36)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:16.873029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:16.942176 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c334514e1d94aef8307c59d779c9d36'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:16.942896 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c334514e1d94aef8307c59d779c9d36'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:16.957684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c334514e1d94aef8307c59d779c9d36'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:16.966939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c334514e1d94aef8307c59d779c9d36'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:16.978757 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c334514e1d94aef8307c59d779c9d36'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:16.989810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1419/2816] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:16 2022] DELETE /identity/v3/users/9c334514e1d94aef8307c59d779c9d36 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:16.996066 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1711-8cc8-4563-8010-c14c8a90bc5c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:16.996739 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1711-8cc8-4563-8010-c14c8a90bc5c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:16.996907 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1711-8cc8-4563-8010-c14c8a90bc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.018960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c43a1711-8cc8-4563-8010-c14c8a90bc5c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:17.020174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c43a1711-8cc8-4563-8010-c14c8a90bc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.080125 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:17.081683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.108144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1398/2817] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:17.125493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a1711-8cc8-4563-8010-c14c8a90bc5c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:17.128025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c43a1711-8cc8-4563-8010-c14c8a90bc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.169115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f921-de24-4473-ad8f-82eee92d3a0e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:17.177974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:17.179362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.179887 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.180419 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] PATH_INFO: `/v3/users/380d2aa1757e46f680e54b56498fe63a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.183241 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=380d2aa1757e46f680e54b56498fe63a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:17.185614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:17.208206 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:17.227624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a1711-8cc8-4563-8010-c14c8a90bc5c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:17.234980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2aca1-130f-4f38-98cb-89df86f79612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:17.236047 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2aca1-130f-4f38-98cb-89df86f79612 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.236430 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2aca1-130f-4f38-98cb-89df86f79612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.236966 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2aca1-130f-4f38-98cb-89df86f79612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.245891 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:17.251327 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2aca1-130f-4f38-98cb-89df86f79612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:17.253991 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2aca1-130f-4f38-98cb-89df86f79612 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:17.260375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380d2aa1757e46f680e54b56498fe63a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.261448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380d2aa1757e46f680e54b56498fe63a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.270785 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1399/2818] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:44:17.279012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380d2aa1757e46f680e54b56498fe63a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.295066 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380d2aa1757e46f680e54b56498fe63a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.313473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380d2aa1757e46f680e54b56498fe63a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.323375 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1420/2819] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:17 2022] DELETE /identity/v3/users/380d2aa1757e46f680e54b56498fe63a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:17.329594 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcead1-9fa5-46a9-a9a4-74c2c7a12f4d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.329953 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcead1-9fa5-46a9-a9a4-74c2c7a12f4d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.330162 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcead1-9fa5-46a9-a9a4-74c2c7a12f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.351254 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-09bcead1-9fa5-46a9-a9a4-74c2c7a12f4d None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:17.352497 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-09bcead1-9fa5-46a9-a9a4-74c2c7a12f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.458667 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1400/2820] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:17.471689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:17.473875 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.557755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e9d1d-9276-443d-8441-70380766fc96 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:17.562315 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992164f5-9de2-4750-b3b6-31d44ea21c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:17.562689 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992164f5-9de2-4750-b3b6-31d44ea21c85 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.562867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992164f5-9de2-4750-b3b6-31d44ea21c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.563019 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992164f5-9de2-4750-b3b6-31d44ea21c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.576744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992164f5-9de2-4750-b3b6-31d44ea21c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:17.579549 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992164f5-9de2-4750-b3b6-31d44ea21c85 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:17.610017 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1421/2821] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:17.752624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcead1-9fa5-46a9-a9a4-74c2c7a12f4d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:17.754861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-09bcead1-9fa5-46a9-a9a4-74c2c7a12f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.781531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcead1-9fa5-46a9-a9a4-74c2c7a12f4d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:17.789398 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:17.790207 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.790641 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.790975 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] PATH_INFO: `/v3/projects/69a94b3a00754d66b47dcc79dd2b6242` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.792359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a94b3a00754d66b47dcc79dd2b6242)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:17.794361 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:17.880709 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a94b3a00754d66b47dcc79dd2b6242', 'request_id': 'req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.893975 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a94b3a00754d66b47dcc79dd2b6242', 'request_id': 'req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.904096 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a94b3a00754d66b47dcc79dd2b6242', 'request_id': 'req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.931970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] The token cache is being invalidate because project 69a94b3a00754d66b47dcc79dd2b6242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:17.932578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.933852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:17.937978 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1401/2822] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:17 2022] DELETE /identity/v3/projects/69a94b3a00754d66b47dcc79dd2b6242 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:17.943668 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992164f5-9de2-4750-b3b6-31d44ea21c85 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:17.962048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992164f5-9de2-4750-b3b6-31d44ea21c85 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.083765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.084344 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.084619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.084890 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] PATH_INFO: `/v3/users/16d44280651149ee9f9506d4ba33dc69` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.086447 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d44280651149ee9f9506d4ba33dc69)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.088648 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.099879 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.103605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.122406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c383b04-6cc0-4e8b-90f4-e1ce05f5ca9c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.128208 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.128873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.129149 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.129425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] PATH_INFO: `/v3/projects/4978ed505af74df5871f9e6c5256241c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.130703 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4978ed505af74df5871f9e6c5256241c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.132765 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.198355 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d44280651149ee9f9506d4ba33dc69'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.199605 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d44280651149ee9f9506d4ba33dc69'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.227053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4978ed505af74df5871f9e6c5256241c', 'request_id': 'req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.236323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:18.241468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4978ed505af74df5871f9e6c5256241c', 'request_id': 'req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.246854 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d44280651149ee9f9506d4ba33dc69'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.255887 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4978ed505af74df5871f9e6c5256241c', 'request_id': 'req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.261627 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:18.262127 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d44280651149ee9f9506d4ba33dc69'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.279853 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-faed8511-b121-4350-aab4-9b41d5bb3347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d44280651149ee9f9506d4ba33dc69'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.290271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] The token cache is being invalidate because project 4978ed505af74df5871f9e6c5256241c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:18.290814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.292675 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-647b87ed-a9f1-49c8-ac18-4a3a0a7dec53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:18.295170 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1402/2824] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:18 2022] DELETE /identity/v3/projects/4978ed505af74df5871f9e6c5256241c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:18.297326 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1422/2824] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:17 2022] DELETE /identity/v3/users/16d44280651149ee9f9506d4ba33dc69 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:18.302390 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491a63c-bef7-44b3-a3f3-cee2c6d1d67c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.302933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491a63c-bef7-44b3-a3f3-cee2c6d1d67c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.303433 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491a63c-bef7-44b3-a3f3-cee2c6d1d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.347889 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b491a63c-bef7-44b3-a3f3-cee2c6d1d67c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:18.349789 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b491a63c-bef7-44b3-a3f3-cee2c6d1d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.470803 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1403/2825] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:18.472664 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6c438-b4a8-45b9-b2d1-d14ebd9f48e0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.472950 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6c438-b4a8-45b9-b2d1-d14ebd9f48e0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.473222 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6c438-b4a8-45b9-b2d1-d14ebd9f48e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.497781 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-06f6c438-b4a8-45b9-b2d1-d14ebd9f48e0 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:18.499567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-06f6c438-b4a8-45b9-b2d1-d14ebd9f48e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.523079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1423/2826] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:18.527874 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491a63c-bef7-44b3-a3f3-cee2c6d1d67c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.539864 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491a63c-bef7-44b3-a3f3-cee2c6d1d67c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.545005 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d3380-26e9-4748-a5dc-d380bff6637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.546191 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d3380-26e9-4748-a5dc-d380bff6637f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.546563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d3380-26e9-4748-a5dc-d380bff6637f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.546881 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d3380-26e9-4748-a5dc-d380bff6637f admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.555655 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d3380-26e9-4748-a5dc-d380bff6637f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:44:18.555655 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d3380-26e9-4748-a5dc-d380bff6637f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.555655 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d3380-26e9-4748-a5dc-d380bff6637f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.571125 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1404/2827] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:44:18.573441 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6c438-b4a8-45b9-b2d1-d14ebd9f48e0 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.586807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6c438-b4a8-45b9-b2d1-d14ebd9f48e0 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.593162 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67750861-25ef-4684-9f0b-bc58ab9b5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.593813 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67750861-25ef-4684-9f0b-bc58ab9b5f50 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.594089 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67750861-25ef-4684-9f0b-bc58ab9b5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.594357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67750861-25ef-4684-9f0b-bc58ab9b5f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.595060 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67750861-25ef-4684-9f0b-bc58ab9b5f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.597018 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67750861-25ef-4684-9f0b-bc58ab9b5f50 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.647679 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1424/2828] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:18 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:18.655853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d3380-26e9-4748-a5dc-d380bff6637f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.676341 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d3380-26e9-4748-a5dc-d380bff6637f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.740846 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67750861-25ef-4684-9f0b-bc58ab9b5f50 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.743646 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-67750861-25ef-4684-9f0b-bc58ab9b5f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.820762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defb42b-8eb3-4ecd-81ac-d465db3f17d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.822270 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defb42b-8eb3-4ecd-81ac-d465db3f17d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.822784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defb42b-8eb3-4ecd-81ac-d465db3f17d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.823273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defb42b-8eb3-4ecd-81ac-d465db3f17d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.824442 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defb42b-8eb3-4ecd-81ac-d465db3f17d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.828786 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defb42b-8eb3-4ecd-81ac-d465db3f17d2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.870320 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1405/2829] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:18 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:18.877004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defb42b-8eb3-4ecd-81ac-d465db3f17d2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.898577 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defb42b-8eb3-4ecd-81ac-d465db3f17d2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.906801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67750861-25ef-4684-9f0b-bc58ab9b5f50 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.908810 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f53e03-ee6d-4965-abdb-399316ee27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.910126 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f53e03-ee6d-4965-abdb-399316ee27ea admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.911266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f53e03-ee6d-4965-abdb-399316ee27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.911772 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f53e03-ee6d-4965-abdb-399316ee27ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.913008 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f53e03-ee6d-4965-abdb-399316ee27ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.915949 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.916184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f53e03-ee6d-4965-abdb-399316ee27ea admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.917172 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.919091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.920106 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] PATH_INFO: `/v3/projects/40724628a304413cb7db56dfc02ab909` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.921809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40724628a304413cb7db56dfc02ab909)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.924094 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.947068 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1406/2830] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:44:18.953479 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f53e03-ee6d-4965-abdb-399316ee27ea admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.965710 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f53e03-ee6d-4965-abdb-399316ee27ea admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.971814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e28bdf-0ca9-446e-b60f-14d6e67f1c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.972446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28bdf-0ca9-446e-b60f-14d6e67f1c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.972717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28bdf-0ca9-446e-b60f-14d6e67f1c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.973113 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28bdf-0ca9-446e-b60f-14d6e67f1c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.974144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e28bdf-0ca9-446e-b60f-14d6e67f1c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.976394 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e28bdf-0ca9-446e-b60f-14d6e67f1c4a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.997224 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1407/2831] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:44:19.002253 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e28bdf-0ca9-446e-b60f-14d6e67f1c4a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.015578 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e28bdf-0ca9-446e-b60f-14d6e67f1c4a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.053566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40724628a304413cb7db56dfc02ab909', 'request_id': 'req-78079887-6802-4bab-87d3-cf57f27fb7a4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.068147 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40724628a304413cb7db56dfc02ab909', 'request_id': 'req-78079887-6802-4bab-87d3-cf57f27fb7a4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.081636 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40724628a304413cb7db56dfc02ab909', 'request_id': 'req-78079887-6802-4bab-87d3-cf57f27fb7a4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.095069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] The token cache is being invalidate because project 40724628a304413cb7db56dfc02ab909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:19.095415 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.096051 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.097634 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1425/2832] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:18 2022] DELETE /identity/v3/projects/40724628a304413cb7db56dfc02ab909 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:19.101981 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.103504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.103925 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.125836 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7447814-0158-4c54-81ae-8ea52260233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.126638 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7447814-0158-4c54-81ae-8ea52260233e admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.127094 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7447814-0158-4c54-81ae-8ea52260233e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.127359 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7447814-0158-4c54-81ae-8ea52260233e admin admin] PATH_INFO: `/v3/projects/de26dfe824b44cbdb9fba6fa34b3390d/users/a34de75b5d5545539459296372763baf/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.153503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7447814-0158-4c54-81ae-8ea52260233e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de26dfe824b44cbdb9fba6fa34b3390d, user_id=a34de75b5d5545539459296372763baf, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.159245 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7447814-0158-4c54-81ae-8ea52260233e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.170310 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.183468 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1408/2833] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:19 2022] PUT /identity/v3/projects/de26dfe824b44cbdb9fba6fa34b3390d/users/a34de75b5d5545539459296372763baf/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:19.185336 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8950ec6-9053-4940-a5fa-a7edf11dedf1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.186027 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8950ec6-9053-4940-a5fa-a7edf11dedf1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.186440 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8950ec6-9053-4940-a5fa-a7edf11dedf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.214546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a8950ec6-9053-4940-a5fa-a7edf11dedf1 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:19.216587 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a8950ec6-9053-4940-a5fa-a7edf11dedf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.230417 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78079887-6802-4bab-87d3-cf57f27fb7a4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.318322 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135ef14-95db-4eed-9b4a-6fe6d7bd1b34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.319470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135ef14-95db-4eed-9b4a-6fe6d7bd1b34 service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.319967 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135ef14-95db-4eed-9b4a-6fe6d7bd1b34 service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.320446 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135ef14-95db-4eed-9b4a-6fe6d7bd1b34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.320674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1409/2834] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:19.323160 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba150f9-9181-442a-ac47-ad4142967a32 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.323659 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba150f9-9181-442a-ac47-ad4142967a32 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.323994 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c135ef14-95db-4eed-9b4a-6fe6d7bd1b34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.324193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba150f9-9181-442a-ac47-ad4142967a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.346902 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135ef14-95db-4eed-9b4a-6fe6d7bd1b34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.350264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135ef14-95db-4eed-9b4a-6fe6d7bd1b34 service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.371435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1426/2835] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:19.371762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2ba150f9-9181-442a-ac47-ad4142967a32 None None] MFA Rules not processed for user `a34de75b5d5545539459296372763baf`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:19.373050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2ba150f9-9181-442a-ac47-ad4142967a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.373763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb8e7-0103-4a64-a587-be24535431f9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.374256 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb8e7-0103-4a64-a587-be24535431f9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.374763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb8e7-0103-4a64-a587-be24535431f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.410036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-feeeb8e7-0103-4a64-a587-be24535431f9 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:19.412217 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-feeeb8e7-0103-4a64-a587-be24535431f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.432934 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1427/2836] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:19.436372 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeb8e7-0103-4a64-a587-be24535431f9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.456120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeb8e7-0103-4a64-a587-be24535431f9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.465491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1410/2837] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:19.465822 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83fc66-e701-4254-a666-2907f26ee836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.466508 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83fc66-e701-4254-a666-2907f26ee836 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.467032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83fc66-e701-4254-a666-2907f26ee836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.467562 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83fc66-e701-4254-a666-2907f26ee836 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.468864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83fc66-e701-4254-a666-2907f26ee836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:44:19.469688 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83fc66-e701-4254-a666-2907f26ee836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.473038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83fc66-e701-4254-a666-2907f26ee836 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.478041 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba150f9-9181-442a-ac47-ad4142967a32 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.480471 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2ba150f9-9181-442a-ac47-ad4142967a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.498036 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1428/2838] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:44:19.502744 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83fc66-e701-4254-a666-2907f26ee836 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.515238 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83fc66-e701-4254-a666-2907f26ee836 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.520684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f94481-a873-4463-a069-37fd587d746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.521309 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f94481-a873-4463-a069-37fd587d746f admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.521585 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f94481-a873-4463-a069-37fd587d746f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.521908 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f94481-a873-4463-a069-37fd587d746f admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.522575 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f94481-a873-4463-a069-37fd587d746f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.525270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f94481-a873-4463-a069-37fd587d746f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.567619 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1429/2839] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:19 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:44:19.572924 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f94481-a873-4463-a069-37fd587d746f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.593457 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba150f9-9181-442a-ac47-ad4142967a32 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.623724 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.682300 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fcdcb-d00f-4c7a-8676-6da3392b98c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.683384 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fcdcb-d00f-4c7a-8676-6da3392b98c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.683892 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fcdcb-d00f-4c7a-8676-6da3392b98c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.684230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fcdcb-d00f-4c7a-8676-6da3392b98c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.737479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f94481-a873-4463-a069-37fd587d746f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.746785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4e22-e036-466f-9a10-a6930397d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.747898 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4e22-e036-466f-9a10-a6930397d413 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.749706 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4e22-e036-466f-9a10-a6930397d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.749706 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4e22-e036-466f-9a10-a6930397d413 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.750277 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4e22-e036-466f-9a10-a6930397d413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.754130 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4e22-e036-466f-9a10-a6930397d413 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.785755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fcdcb-d00f-4c7a-8676-6da3392b98c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.789531 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fcdcb-d00f-4c7a-8676-6da3392b98c7 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.803116 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1430/2840] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:19 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:19.807917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4e22-e036-466f-9a10-a6930397d413 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.812847 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1411/2841] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:44:19.823498 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4e22-e036-466f-9a10-a6930397d413 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.831410 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8799591-508c-4bf4-bafb-a4b026017f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.832523 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799591-508c-4bf4-bafb-a4b026017f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.833005 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799591-508c-4bf4-bafb-a4b026017f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.833362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8799591-508c-4bf4-bafb-a4b026017f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.834212 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8799591-508c-4bf4-bafb-a4b026017f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.837037 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8799591-508c-4bf4-bafb-a4b026017f52 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.850533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fcdcb-d00f-4c7a-8676-6da3392b98c7 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.852493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c04fcdcb-d00f-4c7a-8676-6da3392b98c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.863434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1431/2842] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:44:19.871766 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8799591-508c-4bf4-bafb-a4b026017f52 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.874827 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fcdcb-d00f-4c7a-8676-6da3392b98c7 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.882491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.884110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.884110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.884110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] PATH_INFO: `/v3/users/a34de75b5d5545539459296372763baf` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.885737 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34de75b5d5545539459296372763baf)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.890217 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.890963 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8799591-508c-4bf4-bafb-a4b026017f52 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.899283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aea9b-c548-441e-b4cc-9889d1f4228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.900269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aea9b-c548-441e-b4cc-9889d1f4228e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.900833 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aea9b-c548-441e-b4cc-9889d1f4228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.901564 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aea9b-c548-441e-b4cc-9889d1f4228e admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.902821 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aea9b-c548-441e-b4cc-9889d1f4228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.905913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aea9b-c548-441e-b4cc-9889d1f4228e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.908680 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.928500 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1432/2843] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:19.934247 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aea9b-c548-441e-b4cc-9889d1f4228e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.954597 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aea9b-c548-441e-b4cc-9889d1f4228e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.971379 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5cfab-1e9c-4477-991e-45abbac9906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.972618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5cfab-1e9c-4477-991e-45abbac9906d admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.973032 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5cfab-1e9c-4477-991e-45abbac9906d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.973502 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5cfab-1e9c-4477-991e-45abbac9906d admin admin] PATH_INFO: `/v3/projects/7b28731ed0e5430a8cff7f79b7f16702/users/436c5fe9aad448fbb7620db31b0ce3ec/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.978081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34de75b5d5545539459296372763baf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.978992 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34de75b5d5545539459296372763baf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.979852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34de75b5d5545539459296372763baf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:20.002431 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5cfab-1e9c-4477-991e-45abbac9906d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b28731ed0e5430a8cff7f79b7f16702, user_id=436c5fe9aad448fbb7620db31b0ce3ec, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:20.003133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34de75b5d5545539459296372763baf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:20.008435 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5cfab-1e9c-4477-991e-45abbac9906d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:20.017775 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-dfda2e9a-2643-4be0-991d-882af4458c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34de75b5d5545539459296372763baf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:20.029004 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1433/2844] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:19 2022] PUT /identity/v3/projects/7b28731ed0e5430a8cff7f79b7f16702/users/436c5fe9aad448fbb7620db31b0ce3ec/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:20.040004 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1412/2845] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:19 2022] DELETE /identity/v3/users/a34de75b5d5545539459296372763baf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:20.043318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628160f-e510-499b-b58b-dd8631c72f60 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:20.043809 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628160f-e510-499b-b58b-dd8631c72f60 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:20.044674 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628160f-e510-499b-b58b-dd8631c72f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:20.046941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e694324-1981-4bb4-8099-a481ec4cc570 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:20.047256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e694324-1981-4bb4-8099-a481ec4cc570 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:20.047705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e694324-1981-4bb4-8099-a481ec4cc570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:20.071230 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3e694324-1981-4bb4-8099-a481ec4cc570 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:20.072552 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e694324-1981-4bb4-8099-a481ec4cc570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.087960 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e628160f-e510-499b-b58b-dd8631c72f60 None None] MFA Rules not processed for user `436c5fe9aad448fbb7620db31b0ce3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:20.089516 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e628160f-e510-499b-b58b-dd8631c72f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.129099 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:20.177657 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1413/2846] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:20.194039 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e694324-1981-4bb4-8099-a481ec4cc570 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:20.197560 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e694324-1981-4bb4-8099-a481ec4cc570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.214616 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1434/2847] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:20.234207 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628160f-e510-499b-b58b-dd8631c72f60 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:20.238753 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e628160f-e510-499b-b58b-dd8631c72f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.320141 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e694324-1981-4bb4-8099-a481ec4cc570 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:20.325044 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b0089-cc6a-4cc8-bf4a-04bf73808ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:20.326109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b0089-cc6a-4cc8-bf4a-04bf73808ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:20.328647 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b0089-cc6a-4cc8-bf4a-04bf73808ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:20.329379 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b0089-cc6a-4cc8-bf4a-04bf73808ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:20.350370 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b0089-cc6a-4cc8-bf4a-04bf73808ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:20.352820 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b0089-cc6a-4cc8-bf4a-04bf73808ea9 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:20.357670 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628160f-e510-499b-b58b-dd8631c72f60 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:20.366900 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f96ea-4cae-4c14-92e9-edbc0b73f321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:20.368245 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f96ea-4cae-4c14-92e9-edbc0b73f321 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:20.368901 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f96ea-4cae-4c14-92e9-edbc0b73f321 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:20.369671 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f96ea-4cae-4c14-92e9-edbc0b73f321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:20.370195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1414/2848] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:44:20.387318 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f96ea-4cae-4c14-92e9-edbc0b73f321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:20.388951 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f96ea-4cae-4c14-92e9-edbc0b73f321 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:20.401049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1435/2849] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:44:20.436446 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b0089-cc6a-4cc8-bf4a-04bf73808ea9 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:20.440922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1c6b0089-cc6a-4cc8-bf4a-04bf73808ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.467841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b0089-cc6a-4cc8-bf4a-04bf73808ea9 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:20.477912 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:20.479040 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:20.480264 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:20.480264 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] PATH_INFO: `/v3/users/436c5fe9aad448fbb7620db31b0ce3ec` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:20.482600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436c5fe9aad448fbb7620db31b0ce3ec)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:20.486089 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:20.584705 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436c5fe9aad448fbb7620db31b0ce3ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:20.586216 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436c5fe9aad448fbb7620db31b0ce3ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:20.587736 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436c5fe9aad448fbb7620db31b0ce3ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:20.615606 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436c5fe9aad448fbb7620db31b0ce3ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:20.624851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436c5fe9aad448fbb7620db31b0ce3ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:20.644236 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1415/2850] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:20 2022] DELETE /identity/v3/users/436c5fe9aad448fbb7620db31b0ce3ec => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:20.651343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d495b-6355-47bc-b8e5-02038971d3c7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:20.651791 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d495b-6355-47bc-b8e5-02038971d3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:20.652264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d495b-6355-47bc-b8e5-02038971d3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:20.702469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-458d495b-6355-47bc-b8e5-02038971d3c7 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:20.704345 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-458d495b-6355-47bc-b8e5-02038971d3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.790513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:20.795465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.844493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1436/2851] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:20.860055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d495b-6355-47bc-b8e5-02038971d3c7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:20.865239 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-458d495b-6355-47bc-b8e5-02038971d3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.888283 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:20.997952 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672699f-52e3-4d8f-b4d7-e9bae9d58912 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:21.007161 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:21.007933 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:21.008513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:21.008857 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] PATH_INFO: `/v3/projects/de26dfe824b44cbdb9fba6fa34b3390d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:21.011132 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de26dfe824b44cbdb9fba6fa34b3390d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:21.013825 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:21.018518 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:21.049460 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d495b-6355-47bc-b8e5-02038971d3c7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:21.058747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158dada-fb83-40fb-8d16-f22703bfd48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:21.060861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158dada-fb83-40fb-8d16-f22703bfd48c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:21.062050 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158dada-fb83-40fb-8d16-f22703bfd48c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:21.062911 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158dada-fb83-40fb-8d16-f22703bfd48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:21.086522 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158dada-fb83-40fb-8d16-f22703bfd48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:21.088480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158dada-fb83-40fb-8d16-f22703bfd48c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:21.100504 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1437/2852] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:21.131090 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de26dfe824b44cbdb9fba6fa34b3390d', 'request_id': 'req-b89308c1-833f-463c-9122-69ea4b034824'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:21.143674 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de26dfe824b44cbdb9fba6fa34b3390d', 'request_id': 'req-b89308c1-833f-463c-9122-69ea4b034824'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:21.155645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de26dfe824b44cbdb9fba6fa34b3390d', 'request_id': 'req-b89308c1-833f-463c-9122-69ea4b034824'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:21.179808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] The token cache is being invalidate because project de26dfe824b44cbdb9fba6fa34b3390d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:21.180277 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:21.181417 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b89308c1-833f-463c-9122-69ea4b034824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:21.184166 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1416/2853] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:20 2022] DELETE /identity/v3/projects/de26dfe824b44cbdb9fba6fa34b3390d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:21.810118 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158dada-fb83-40fb-8d16-f22703bfd48c service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:21.813733 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f158dada-fb83-40fb-8d16-f22703bfd48c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:21.847296 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158dada-fb83-40fb-8d16-f22703bfd48c service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:21.929672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:21.930557 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:21.930868 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:21.931142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] PATH_INFO: `/v3/projects/7b28731ed0e5430a8cff7f79b7f16702` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:21.933031 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b28731ed0e5430a8cff7f79b7f16702)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:21.936111 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:22.006618 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b28731ed0e5430a8cff7f79b7f16702', 'request_id': 'req-12278d4d-9714-4ee9-a1d3-33e1914709b0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:22.017470 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b28731ed0e5430a8cff7f79b7f16702', 'request_id': 'req-12278d4d-9714-4ee9-a1d3-33e1914709b0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:22.031059 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b28731ed0e5430a8cff7f79b7f16702', 'request_id': 'req-12278d4d-9714-4ee9-a1d3-33e1914709b0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:22.051974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] The token cache is being invalidate because project 7b28731ed0e5430a8cff7f79b7f16702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:22.052484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:22.053974 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-12278d4d-9714-4ee9-a1d3-33e1914709b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:22.056999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1438/2854] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:21 2022] DELETE /identity/v3/projects/7b28731ed0e5430a8cff7f79b7f16702 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:22.062967 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d25c-df98-4c61-8b1d-cca452d90185 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:22.063431 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d25c-df98-4c61-8b1d-cca452d90185 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:22.063893 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d25c-df98-4c61-8b1d-cca452d90185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:22.090444 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-87d6d25c-df98-4c61-8b1d-cca452d90185 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:22.092699 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-87d6d25c-df98-4c61-8b1d-cca452d90185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:22.190261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1417/2855] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:22.201101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16101cf-29eb-40f6-aee2-1678518bb2a4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:22.201737 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16101cf-29eb-40f6-aee2-1678518bb2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:22.202134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16101cf-29eb-40f6-aee2-1678518bb2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:22.243736 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d16101cf-29eb-40f6-aee2-1678518bb2a4 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:22.245913 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d16101cf-29eb-40f6-aee2-1678518bb2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:22.263181 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1439/2856] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:22.267195 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d25c-df98-4c61-8b1d-cca452d90185 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:22.283252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d25c-df98-4c61-8b1d-cca452d90185 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:22.291503 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629e7cd-fcc8-45c1-82c5-221bd7c5839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:22.292447 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e7cd-fcc8-45c1-82c5-221bd7c5839c admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:22.292896 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e7cd-fcc8-45c1-82c5-221bd7c5839c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:22.293164 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e7cd-fcc8-45c1-82c5-221bd7c5839c admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:22.293830 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629e7cd-fcc8-45c1-82c5-221bd7c5839c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:44:22.294344 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629e7cd-fcc8-45c1-82c5-221bd7c5839c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:22.296794 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629e7cd-fcc8-45c1-82c5-221bd7c5839c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:22.316761 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1418/2857] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:44:22.324858 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16101cf-29eb-40f6-aee2-1678518bb2a4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:22.342851 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16101cf-29eb-40f6-aee2-1678518bb2a4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:22.351784 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1dc9-0ef0-40f5-b0ee-3badd59adda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:22.352823 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1dc9-0ef0-40f5-b0ee-3badd59adda5 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:22.353298 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1dc9-0ef0-40f5-b0ee-3badd59adda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:22.353776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1dc9-0ef0-40f5-b0ee-3badd59adda5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:22.354939 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a1dc9-0ef0-40f5-b0ee-3badd59adda5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:22.358861 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a1dc9-0ef0-40f5-b0ee-3badd59adda5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:22.414552 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1440/2858] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:22 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:22.417865 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629e7cd-fcc8-45c1-82c5-221bd7c5839c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:22.432476 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629e7cd-fcc8-45c1-82c5-221bd7c5839c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:22.527625 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12188d-4d36-4a1a-9b85-26790aa44cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:22.528528 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12188d-4d36-4a1a-9b85-26790aa44cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:22.528975 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12188d-4d36-4a1a-9b85-26790aa44cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:22.529335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12188d-4d36-4a1a-9b85-26790aa44cdc admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:22.530358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12188d-4d36-4a1a-9b85-26790aa44cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:22.533269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12188d-4d36-4a1a-9b85-26790aa44cdc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:22.563945 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1419/2859] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:22 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:44:22.565484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1dc9-0ef0-40f5-b0ee-3badd59adda5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:22.578043 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1dc9-0ef0-40f5-b0ee-3badd59adda5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:22.583799 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a486-4b02-4cfc-94e9-9d1aace8bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:22.584610 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a486-4b02-4cfc-94e9-9d1aace8bf46 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:22.584986 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a486-4b02-4cfc-94e9-9d1aace8bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:22.585357 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a486-4b02-4cfc-94e9-9d1aace8bf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:22.586143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2a486-4b02-4cfc-94e9-9d1aace8bf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:22.587965 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2a486-4b02-4cfc-94e9-9d1aace8bf46 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:22.596749 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:22.608534 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12188d-4d36-4a1a-9b85-26790aa44cdc admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:22.618348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1441/2860] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:44:22.621563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12188d-4d36-4a1a-9b85-26790aa44cdc admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:22.630601 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e49d5-5b56-418a-b793-23c3cf23edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:22.632071 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e49d5-5b56-418a-b793-23c3cf23edaa admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:22.632452 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e49d5-5b56-418a-b793-23c3cf23edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:22.632824 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e49d5-5b56-418a-b793-23c3cf23edaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:22.634285 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e49d5-5b56-418a-b793-23c3cf23edaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:22.636283 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e49d5-5b56-418a-b793-23c3cf23edaa admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:22.639310 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:22.658702 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1420/2861] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:22.659970 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a486-4b02-4cfc-94e9-9d1aace8bf46 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:22.678291 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a486-4b02-4cfc-94e9-9d1aace8bf46 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:22.688090 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc4a13-36eb-439d-a3bc-38208eb2c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:22.689452 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc4a13-36eb-439d-a3bc-38208eb2c0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:22.690057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc4a13-36eb-439d-a3bc-38208eb2c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:22.690647 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc4a13-36eb-439d-a3bc-38208eb2c0e4 admin admin] PATH_INFO: `/v3/projects/212fc21496424398a73dac17e3346894/users/044ae0c9194a409681c8921b37c40bfd/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:22.722380 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc4a13-36eb-439d-a3bc-38208eb2c0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212fc21496424398a73dac17e3346894, user_id=044ae0c9194a409681c8921b37c40bfd, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:22.728576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc4a13-36eb-439d-a3bc-38208eb2c0e4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:22.756899 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1442/2862] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:22 2022] PUT /identity/v3/projects/212fc21496424398a73dac17e3346894/users/044ae0c9194a409681c8921b37c40bfd/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:22.769410 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80771dca-0a24-4438-aa59-3fb825df71dc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:22.769717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80771dca-0a24-4438-aa59-3fb825df71dc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:22.769960 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80771dca-0a24-4438-aa59-3fb825df71dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:22.806502 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-80771dca-0a24-4438-aa59-3fb825df71dc None None] MFA Rules not processed for user `044ae0c9194a409681c8921b37c40bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:22.808332 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-80771dca-0a24-4438-aa59-3fb825df71dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:22.905508 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1421/2863] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:22.923478 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc4a13-36eb-439d-a3bc-38208eb2c0e4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:22.926348 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c3cc4a13-36eb-439d-a3bc-38208eb2c0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:23.032120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc4a13-36eb-439d-a3bc-38208eb2c0e4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:23.038477 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753ca86-cb16-4ad9-90b5-fb005cb310be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:23.039563 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753ca86-cb16-4ad9-90b5-fb005cb310be service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:23.039988 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753ca86-cb16-4ad9-90b5-fb005cb310be service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:23.040454 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753ca86-cb16-4ad9-90b5-fb005cb310be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:23.057764 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753ca86-cb16-4ad9-90b5-fb005cb310be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:23.060590 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753ca86-cb16-4ad9-90b5-fb005cb310be service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:23.081999 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1443/2864] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:28.965338 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80771dca-0a24-4438-aa59-3fb825df71dc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:29.043757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80771dca-0a24-4438-aa59-3fb825df71dc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:29.050252 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:29.050986 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:29.051266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:29.051537 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] PATH_INFO: `/v3/users/044ae0c9194a409681c8921b37c40bfd` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:29.052922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=044ae0c9194a409681c8921b37c40bfd)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:29.055505 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:29.123533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '044ae0c9194a409681c8921b37c40bfd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:29.124145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '044ae0c9194a409681c8921b37c40bfd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:29.124971 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '044ae0c9194a409681c8921b37c40bfd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:29.139866 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '044ae0c9194a409681c8921b37c40bfd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:29.148372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '044ae0c9194a409681c8921b37c40bfd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:29.167804 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1422/2865] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:28 2022] DELETE /identity/v3/users/044ae0c9194a409681c8921b37c40bfd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:29.173669 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235154c-2426-4558-9195-51b9b99d648c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:29.174572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235154c-2426-4558-9195-51b9b99d648c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:29.174572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235154c-2426-4558-9195-51b9b99d648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:29.199641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0235154c-2426-4558-9195-51b9b99d648c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:29.201038 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0235154c-2426-4558-9195-51b9b99d648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:29.290882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1444/2866] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:44:29.305171 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:29.306714 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:29.314622 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:29.399533 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392645d-35f5-4e82-bbf8-34495415b2ce admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:29.406325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acca85-c5e5-41f3-aa31-cb0889877b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:29.407365 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acca85-c5e5-41f3-aa31-cb0889877b87 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:29.407842 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acca85-c5e5-41f3-aa31-cb0889877b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:29.408321 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acca85-c5e5-41f3-aa31-cb0889877b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:29.426269 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acca85-c5e5-41f3-aa31-cb0889877b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:29.428218 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acca85-c5e5-41f3-aa31-cb0889877b87 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:29.446851 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1423/2867] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:29.853785 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235154c-2426-4558-9195-51b9b99d648c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:29.856121 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0235154c-2426-4558-9195-51b9b99d648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:29.955148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acca85-c5e5-41f3-aa31-cb0889877b87 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:29.957697 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-54acca85-c5e5-41f3-aa31-cb0889877b87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:29.988730 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acca85-c5e5-41f3-aa31-cb0889877b87 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:29.997645 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:29.999076 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:29.999521 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.000144 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] PATH_INFO: `/v3/projects/212fc21496424398a73dac17e3346894` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.003151 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212fc21496424398a73dac17e3346894)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:30.007409 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:30.056547 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235154c-2426-4558-9195-51b9b99d648c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:30.066995 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c509c2-9863-492a-acb9-cd38854dc4fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:30.068081 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c509c2-9863-492a-acb9-cd38854dc4fa service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.068567 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c509c2-9863-492a-acb9-cd38854dc4fa service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.069124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c509c2-9863-492a-acb9-cd38854dc4fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.076811 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c5c509c2-9863-492a-acb9-cd38854dc4fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:30.105364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c509c2-9863-492a-acb9-cd38854dc4fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:30.108489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c509c2-9863-492a-acb9-cd38854dc4fa service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:30.109818 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212fc21496424398a73dac17e3346894', 'request_id': 'req-c6df9e49-36fd-4944-87aa-26874eac7535'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:30.123731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212fc21496424398a73dac17e3346894', 'request_id': 'req-c6df9e49-36fd-4944-87aa-26874eac7535'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:30.130631 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1445/2868] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:30.144707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212fc21496424398a73dac17e3346894', 'request_id': 'req-c6df9e49-36fd-4944-87aa-26874eac7535'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:30.172853 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] The token cache is being invalidate because project 212fc21496424398a73dac17e3346894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:30.173383 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:30.174287 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c6df9e49-36fd-4944-87aa-26874eac7535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:30.176979 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1424/2869] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:29 2022] DELETE /identity/v3/projects/212fc21496424398a73dac17e3346894 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:30.184108 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8f23-d179-4066-bd65-f0e07cb8b332 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.185364 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8f23-d179-4066-bd65-f0e07cb8b332 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.186352 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8f23-d179-4066-bd65-f0e07cb8b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.202463 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:30.225690 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-484e8f23-d179-4066-bd65-f0e07cb8b332 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:30.227711 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-484e8f23-d179-4066-bd65-f0e07cb8b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:30.343948 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1446/2870] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:30.353246 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6383-9220-48d7-8409-7dbb355b670c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.353740 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6383-9220-48d7-8409-7dbb355b670c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.354266 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb6383-9220-48d7-8409-7dbb355b670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.378974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e7eb6383-9220-48d7-8409-7dbb355b670c None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:30.380293 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e7eb6383-9220-48d7-8409-7dbb355b670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:30.392165 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1425/2871] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:30.397543 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8f23-d179-4066-bd65-f0e07cb8b332 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:30.412819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8f23-d179-4066-bd65-f0e07cb8b332 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:30.421708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82709a3-8892-4288-8c9e-22d7d1302a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:30.423114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82709a3-8892-4288-8c9e-22d7d1302a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.423607 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82709a3-8892-4288-8c9e-22d7d1302a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.424100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82709a3-8892-4288-8c9e-22d7d1302a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.425389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82709a3-8892-4288-8c9e-22d7d1302a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:44:30.426058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82709a3-8892-4288-8c9e-22d7d1302a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:30.429742 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82709a3-8892-4288-8c9e-22d7d1302a3f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:30.457109 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1447/2872] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:44:30.464455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6383-9220-48d7-8409-7dbb355b670c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:30.476414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb6383-9220-48d7-8409-7dbb355b670c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:30.481707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ae4ef-fd9f-4441-b0ac-9714f5182f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:30.482342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ae4ef-fd9f-4441-b0ac-9714f5182f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.482619 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ae4ef-fd9f-4441-b0ac-9714f5182f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.483054 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ae4ef-fd9f-4441-b0ac-9714f5182f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.483726 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ae4ef-fd9f-4441-b0ac-9714f5182f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:30.485735 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ae4ef-fd9f-4441-b0ac-9714f5182f0c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:30.517205 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1426/2873] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:30 2022] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:44:30.521819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82709a3-8892-4288-8c9e-22d7d1302a3f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:30.533577 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82709a3-8892-4288-8c9e-22d7d1302a3f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:30.608398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86766d7-0d3b-403d-8226-06cddf5d7dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:30.609339 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86766d7-0d3b-403d-8226-06cddf5d7dea admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.609747 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86766d7-0d3b-403d-8226-06cddf5d7dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.610138 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86766d7-0d3b-403d-8226-06cddf5d7dea admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.611209 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86766d7-0d3b-403d-8226-06cddf5d7dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:30.614528 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86766d7-0d3b-403d-8226-06cddf5d7dea admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:30.646363 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1448/2874] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:30 2022] POST /identity/v3/users => generated 281 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:30.653163 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ae4ef-fd9f-4441-b0ac-9714f5182f0c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:30.674819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ae4ef-fd9f-4441-b0ac-9714f5182f0c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:30.685500 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfabe4c-39bb-4949-bb94-37e239187a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:30.686819 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfabe4c-39bb-4949-bb94-37e239187a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.687401 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfabe4c-39bb-4949-bb94-37e239187a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.687959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfabe4c-39bb-4949-bb94-37e239187a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.689243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfabe4c-39bb-4949-bb94-37e239187a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:30.692439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfabe4c-39bb-4949-bb94-37e239187a99 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:30.714564 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1427/2875] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:30.721288 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86766d7-0d3b-403d-8226-06cddf5d7dea admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:30.734576 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86766d7-0d3b-403d-8226-06cddf5d7dea admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:30.741114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9dd1c-c449-4e86-a386-61d3261aac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:30.742548 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9dd1c-c449-4e86-a386-61d3261aac4f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.743035 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9dd1c-c449-4e86-a386-61d3261aac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.743503 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9dd1c-c449-4e86-a386-61d3261aac4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.744694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9dd1c-c449-4e86-a386-61d3261aac4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:30.747904 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9dd1c-c449-4e86-a386-61d3261aac4f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:30.769069 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1449/2876] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:30.775108 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfabe4c-39bb-4949-bb94-37e239187a99 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:30.789644 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfabe4c-39bb-4949-bb94-37e239187a99 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:30.795520 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b38c1-105a-4d09-a4a3-e8cf948b8ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:30.796439 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b38c1-105a-4d09-a4a3-e8cf948b8ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.796826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b38c1-105a-4d09-a4a3-e8cf948b8ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.797196 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b38c1-105a-4d09-a4a3-e8cf948b8ea5 admin admin] PATH_INFO: `/v3/projects/83f9f4f450a042298318b7d649d4ec77/users/4db3db09a163453880c1a125668eea30/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.816193 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b38c1-105a-4d09-a4a3-e8cf948b8ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f9f4f450a042298318b7d649d4ec77, user_id=4db3db09a163453880c1a125668eea30, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:30.818953 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b38c1-105a-4d09-a4a3-e8cf948b8ea5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:30.834927 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1428/2877] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:30 2022] PUT /identity/v3/projects/83f9f4f450a042298318b7d649d4ec77/users/4db3db09a163453880c1a125668eea30/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:30.845929 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278cb8-4f35-4d51-bc65-1476f629569e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.846208 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278cb8-4f35-4d51-bc65-1476f629569e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.846480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278cb8-4f35-4d51-bc65-1476f629569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.881665 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0f278cb8-4f35-4d51-bc65-1476f629569e None None] MFA Rules not processed for user `4db3db09a163453880c1a125668eea30`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:30.883864 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0f278cb8-4f35-4d51-bc65-1476f629569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:30.994011 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:31.004599 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1450/2878] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:44:31.044424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b38c1-105a-4d09-a4a3-e8cf948b8ea5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:31.047554 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dd9b38c1-105a-4d09-a4a3-e8cf948b8ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:31.105651 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:31.148770 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b38c1-105a-4d09-a4a3-e8cf948b8ea5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:31.153375 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b52f4-1a0d-4326-8b5c-869f9e996084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:31.154050 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b52f4-1a0d-4326-8b5c-869f9e996084 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:31.154374 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b52f4-1a0d-4326-8b5c-869f9e996084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:31.155006 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b52f4-1a0d-4326-8b5c-869f9e996084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:31.167143 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b52f4-1a0d-4326-8b5c-869f9e996084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:31.168932 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b52f4-1a0d-4326-8b5c-869f9e996084 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:31.181010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1429/2879] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:44:31.208442 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278cb8-4f35-4d51-bc65-1476f629569e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:31.298323 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278cb8-4f35-4d51-bc65-1476f629569e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:31.304204 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:31.304983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:31.305353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:31.305798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] PATH_INFO: `/v3/users/4db3db09a163453880c1a125668eea30` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:31.307389 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db3db09a163453880c1a125668eea30)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:31.309413 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:31.411168 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db3db09a163453880c1a125668eea30'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:31.412254 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db3db09a163453880c1a125668eea30'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:31.431660 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db3db09a163453880c1a125668eea30'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:31.446224 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db3db09a163453880c1a125668eea30'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:31.461098 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db3db09a163453880c1a125668eea30'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:31.469653 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1451/2880] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:31 2022] DELETE /identity/v3/users/4db3db09a163453880c1a125668eea30 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:31.476494 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26695c-2ef6-4b9c-b2c0-f400fc4a774f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:31.477325 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26695c-2ef6-4b9c-b2c0-f400fc4a774f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:31.477752 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26695c-2ef6-4b9c-b2c0-f400fc4a774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:31.514088 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cc26695c-2ef6-4b9c-b2c0-f400fc4a774f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:31.516184 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cc26695c-2ef6-4b9c-b2c0-f400fc4a774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:31.614917 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1430/2881] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:31.626472 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:31.628079 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:31.703048 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8845-bdf0-4d33-aeaa-5317d0aad726 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:31.706920 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3e24e-cd59-46af-9d11-bce9d08302b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:31.707542 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e24e-cd59-46af-9d11-bce9d08302b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:31.707818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e24e-cd59-46af-9d11-bce9d08302b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:31.708086 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e24e-cd59-46af-9d11-bce9d08302b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:31.720068 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3e24e-cd59-46af-9d11-bce9d08302b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:31.721745 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3e24e-cd59-46af-9d11-bce9d08302b0 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:31.740228 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1452/2882] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:32.097731 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26695c-2ef6-4b9c-b2c0-f400fc4a774f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:32.100148 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cc26695c-2ef6-4b9c-b2c0-f400fc4a774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:32.118680 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26695c-2ef6-4b9c-b2c0-f400fc4a774f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:32.124716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:32.125546 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.126498 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.126922 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] PATH_INFO: `/v3/projects/83f9f4f450a042298318b7d649d4ec77` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.128852 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f9f4f450a042298318b7d649d4ec77)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:32.131683 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:32.209808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f9f4f450a042298318b7d649d4ec77', 'request_id': 'req-0d3988a3-3322-486c-b50d-deb59d313cd2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:32.217884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f9f4f450a042298318b7d649d4ec77', 'request_id': 'req-0d3988a3-3322-486c-b50d-deb59d313cd2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:32.227871 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f9f4f450a042298318b7d649d4ec77', 'request_id': 'req-0d3988a3-3322-486c-b50d-deb59d313cd2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:32.248634 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] The token cache is being invalidate because project 83f9f4f450a042298318b7d649d4ec77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:32.249572 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:32.250469 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0d3988a3-3322-486c-b50d-deb59d313cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:32.253023 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1431/2883] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:32 2022] DELETE /identity/v3/projects/83f9f4f450a042298318b7d649d4ec77 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:32.259859 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557b9b-7673-425e-8751-0e1946b58add None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.260448 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557b9b-7673-425e-8751-0e1946b58add None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.260819 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557b9b-7673-425e-8751-0e1946b58add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.295872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-33557b9b-7673-425e-8751-0e1946b58add None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:32.297492 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-33557b9b-7673-425e-8751-0e1946b58add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:32.318694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:32.391862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1453/2884] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:32.401243 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40304b-545d-4f26-b4c6-741981e45488 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.401640 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40304b-545d-4f26-b4c6-741981e45488 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.401974 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40304b-545d-4f26-b4c6-741981e45488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.425694 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fb40304b-545d-4f26-b4c6-741981e45488 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:32.427351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fb40304b-545d-4f26-b4c6-741981e45488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:32.436322 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1432/2885] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:44:32.441105 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33557b9b-7673-425e-8751-0e1946b58add None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:32.451087 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33557b9b-7673-425e-8751-0e1946b58add None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:32.456434 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9ba63-c081-4f72-b533-dcf59c150c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:32.457058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9ba63-c081-4f72-b533-dcf59c150c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.457334 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9ba63-c081-4f72-b533-dcf59c150c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.457602 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9ba63-c081-4f72-b533-dcf59c150c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.458267 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9ba63-c081-4f72-b533-dcf59c150c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:44:32.458570 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9ba63-c081-4f72-b533-dcf59c150c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:32.460281 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9ba63-c081-4f72-b533-dcf59c150c2f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:32.473681 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1454/2886] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:44:32.478755 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40304b-545d-4f26-b4c6-741981e45488 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:32.490406 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40304b-545d-4f26-b4c6-741981e45488 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:32.495859 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c5f1-893c-4d28-8b82-0c85a783f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:32.496541 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c5f1-893c-4d28-8b82-0c85a783f16f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.496962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c5f1-893c-4d28-8b82-0c85a783f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.497292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c5f1-893c-4d28-8b82-0c85a783f16f admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.497951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9c5f1-893c-4d28-8b82-0c85a783f16f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:32.500553 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9c5f1-893c-4d28-8b82-0c85a783f16f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:32.540808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1433/2887] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:32 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:44:32.547672 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9ba63-c081-4f72-b533-dcf59c150c2f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:32.566161 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9ba63-c081-4f72-b533-dcf59c150c2f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:32.669104 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc2a8f-9c6e-4d7b-8b2f-8541531254b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:32.669863 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc2a8f-9c6e-4d7b-8b2f-8541531254b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.670479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc2a8f-9c6e-4d7b-8b2f-8541531254b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.670886 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc2a8f-9c6e-4d7b-8b2f-8541531254b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.671617 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc2a8f-9c6e-4d7b-8b2f-8541531254b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:32.673658 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc2a8f-9c6e-4d7b-8b2f-8541531254b1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:32.705343 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1455/2888] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:32 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:44:32.709828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c5f1-893c-4d28-8b82-0c85a783f16f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:32.726923 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c5f1-893c-4d28-8b82-0c85a783f16f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:32.730561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf52d4-344f-43d7-a3fd-8ab251723f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:32.731275 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf52d4-344f-43d7-a3fd-8ab251723f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.731535 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf52d4-344f-43d7-a3fd-8ab251723f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.731808 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf52d4-344f-43d7-a3fd-8ab251723f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.732484 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf52d4-344f-43d7-a3fd-8ab251723f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:32.734762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf52d4-344f-43d7-a3fd-8ab251723f1f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:32.748261 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1434/2889] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:44:32.753817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc2a8f-9c6e-4d7b-8b2f-8541531254b1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:32.766071 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc2a8f-9c6e-4d7b-8b2f-8541531254b1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:32.773405 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3efcb4-7c45-476b-a139-7b6fca2c4362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:32.774527 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3efcb4-7c45-476b-a139-7b6fca2c4362 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.775300 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3efcb4-7c45-476b-a139-7b6fca2c4362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.775790 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3efcb4-7c45-476b-a139-7b6fca2c4362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.777273 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3efcb4-7c45-476b-a139-7b6fca2c4362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:32.780624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3efcb4-7c45-476b-a139-7b6fca2c4362 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:32.799068 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1456/2890] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:44:32.804782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf52d4-344f-43d7-a3fd-8ab251723f1f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:32.817342 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf52d4-344f-43d7-a3fd-8ab251723f1f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:32.823291 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a8d51-16fb-4843-ab58-cc6c40d2cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:32.824081 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a8d51-16fb-4843-ab58-cc6c40d2cc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.824377 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a8d51-16fb-4843-ab58-cc6c40d2cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.824655 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a8d51-16fb-4843-ab58-cc6c40d2cc89 admin admin] PATH_INFO: `/v3/projects/d456793fc4d14074bf75972ef6373362/users/eea760edf63245c88fcafc338be227ac/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.839806 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:32.847298 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a8d51-16fb-4843-ab58-cc6c40d2cc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d456793fc4d14074bf75972ef6373362, user_id=eea760edf63245c88fcafc338be227ac, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:32.851539 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a8d51-16fb-4843-ab58-cc6c40d2cc89 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:32.872226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1435/2891] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:32 2022] PUT /identity/v3/projects/d456793fc4d14074bf75972ef6373362/users/eea760edf63245c88fcafc338be227ac/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:32.891319 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1de9-9a6c-49a8-81e6-5b323b3763d7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:32.891828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1de9-9a6c-49a8-81e6-5b323b3763d7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:32.892305 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1de9-9a6c-49a8-81e6-5b323b3763d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:32.944443 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-868a1de9-9a6c-49a8-81e6-5b323b3763d7 None None] MFA Rules not processed for user `eea760edf63245c88fcafc338be227ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:32.946353 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-868a1de9-9a6c-49a8-81e6-5b323b3763d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:33.055338 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1457/2892] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:33.075372 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a8d51-16fb-4843-ab58-cc6c40d2cc89 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:33.078226 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a68a8d51-16fb-4843-ab58-cc6c40d2cc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:33.090451 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a1de9-9a6c-49a8-81e6-5b323b3763d7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:33.092004 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-868a1de9-9a6c-49a8-81e6-5b323b3763d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:33.113269 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:33.165341 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a1de9-9a6c-49a8-81e6-5b323b3763d7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:33.169458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ee53d-4d38-43e2-8938-f7e36f217c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:33.170120 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ee53d-4d38-43e2-8938-f7e36f217c6d service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:33.170433 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ee53d-4d38-43e2-8938-f7e36f217c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:33.170740 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ee53d-4d38-43e2-8938-f7e36f217c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:33.172721 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c27ee53d-4d38-43e2-8938-f7e36f217c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:33.183449 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a8d51-16fb-4843-ab58-cc6c40d2cc89 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:33.187695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6983516-8394-4f28-aa65-bae216f65959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:33.188340 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6983516-8394-4f28-aa65-bae216f65959 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:33.188612 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6983516-8394-4f28-aa65-bae216f65959 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:33.188883 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6983516-8394-4f28-aa65-bae216f65959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:33.198784 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6983516-8394-4f28-aa65-bae216f65959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:33.200296 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6983516-8394-4f28-aa65-bae216f65959 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:33.211292 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1436/2893] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:33.281301 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ee53d-4d38-43e2-8938-f7e36f217c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:33.283945 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ee53d-4d38-43e2-8938-f7e36f217c6d service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:33.297959 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1458/2894] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:44:35.968465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6983516-8394-4f28-aa65-bae216f65959 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:36.088354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6983516-8394-4f28-aa65-bae216f65959 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:36.095053 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:36.095884 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:36.096632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:36.096632 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] PATH_INFO: `/v3/users/eea760edf63245c88fcafc338be227ac` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:36.099219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea760edf63245c88fcafc338be227ac)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:36.100563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:36.185890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea760edf63245c88fcafc338be227ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:36.187526 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea760edf63245c88fcafc338be227ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:36.188629 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea760edf63245c88fcafc338be227ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:36.218700 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea760edf63245c88fcafc338be227ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:36.237473 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea760edf63245c88fcafc338be227ac'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:36.265661 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1437/2895] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:35 2022] DELETE /identity/v3/users/eea760edf63245c88fcafc338be227ac => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:36.271787 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc324-937d-4da7-9330-1e80ab0c066f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:36.273265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc324-937d-4da7-9330-1e80ab0c066f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:36.273712 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc324-937d-4da7-9330-1e80ab0c066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:36.310569 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-402dc324-937d-4da7-9330-1e80ab0c066f None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:36.312772 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-402dc324-937d-4da7-9330-1e80ab0c066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:36.424755 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1459/2896] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:36.439821 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:36.442140 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:36.462814 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:36.542762 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38b19b-8e15-4ef8-a8c8-00f80b6a0b44 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:36.547993 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdb1ba-d241-47d9-9807-95b94a09a6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:36.549079 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdb1ba-d241-47d9-9807-95b94a09a6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:36.550109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdb1ba-d241-47d9-9807-95b94a09a6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:36.550109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdb1ba-d241-47d9-9807-95b94a09a6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:36.570256 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdb1ba-d241-47d9-9807-95b94a09a6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:36.574189 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdb1ba-d241-47d9-9807-95b94a09a6f5 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:36.589095 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1438/2897] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:37.054418 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dc324-937d-4da7-9330-1e80ab0c066f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:37.056479 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-402dc324-937d-4da7-9330-1e80ab0c066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:37.081411 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dc324-937d-4da7-9330-1e80ab0c066f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:37.091144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:37.092223 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.092707 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.093194 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] PATH_INFO: `/v3/projects/d456793fc4d14074bf75972ef6373362` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.095801 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d456793fc4d14074bf75972ef6373362)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:37.099392 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:37.174789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd456793fc4d14074bf75972ef6373362', 'request_id': 'req-fb479d6e-8165-4380-bf31-0af58feea1ee'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:37.184349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd456793fc4d14074bf75972ef6373362', 'request_id': 'req-fb479d6e-8165-4380-bf31-0af58feea1ee'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:37.192366 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd456793fc4d14074bf75972ef6373362', 'request_id': 'req-fb479d6e-8165-4380-bf31-0af58feea1ee'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:37.193775 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:37.207480 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] The token cache is being invalidate because project d456793fc4d14074bf75972ef6373362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:37.208049 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:37.209213 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fb479d6e-8165-4380-bf31-0af58feea1ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:37.210776 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1460/2898] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:37 2022] DELETE /identity/v3/projects/d456793fc4d14074bf75972ef6373362 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:37.216462 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716e7d-ee6a-4e54-96a1-750fdc034246 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.217595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716e7d-ee6a-4e54-96a1-750fdc034246 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.217595 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716e7d-ee6a-4e54-96a1-750fdc034246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.241751 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b7716e7d-ee6a-4e54-96a1-750fdc034246 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:37.243020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b7716e7d-ee6a-4e54-96a1-750fdc034246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:37.330516 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1439/2899] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:37.345014 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8bd38-1e66-4750-b121-2bc16f777d34 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.345830 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8bd38-1e66-4750-b121-2bc16f777d34 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.345983 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8bd38-1e66-4750-b121-2bc16f777d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.375308 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-aad8bd38-1e66-4750-b121-2bc16f777d34 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:37.376695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-aad8bd38-1e66-4750-b121-2bc16f777d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:37.387457 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1461/2900] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:37.392337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716e7d-ee6a-4e54-96a1-750fdc034246 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:37.403143 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716e7d-ee6a-4e54-96a1-750fdc034246 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:37.408959 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d46a69-0692-4042-956a-3435226541cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:37.409600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d46a69-0692-4042-956a-3435226541cf admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.409890 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d46a69-0692-4042-956a-3435226541cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.410137 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d46a69-0692-4042-956a-3435226541cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.410873 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d46a69-0692-4042-956a-3435226541cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:44:37.411150 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d46a69-0692-4042-956a-3435226541cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:37.412921 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d46a69-0692-4042-956a-3435226541cf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:37.427337 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1440/2901] 10.222.0.78 () {58 vars in 1153 bytes} [Wed Aug 24 03:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:44:37.433144 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8bd38-1e66-4750-b121-2bc16f777d34 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:37.451374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8bd38-1e66-4750-b121-2bc16f777d34 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:37.459572 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ace3-5339-4e59-a2f7-7406d9b98910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:37.460634 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ace3-5339-4e59-a2f7-7406d9b98910 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.461100 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ace3-5339-4e59-a2f7-7406d9b98910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.461566 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ace3-5339-4e59-a2f7-7406d9b98910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.462630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ace3-5339-4e59-a2f7-7406d9b98910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:37.466206 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ace3-5339-4e59-a2f7-7406d9b98910 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:37.511641 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1462/2902] 10.222.0.78 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:37 2022] POST /identity/v3/projects => generated 399 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:37.517174 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d46a69-0692-4042-956a-3435226541cf admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:37.528802 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d46a69-0692-4042-956a-3435226541cf admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:37.625295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666823-7ac3-4af5-9ac3-af012a616cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:37.626335 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666823-7ac3-4af5-9ac3-af012a616cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.626865 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666823-7ac3-4af5-9ac3-af012a616cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.627351 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666823-7ac3-4af5-9ac3-af012a616cdb admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.628404 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6666823-7ac3-4af5-9ac3-af012a616cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:37.631569 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6666823-7ac3-4af5-9ac3-af012a616cdb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:37.668826 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1441/2903] 10.222.0.78 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:37 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:37.674683 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ace3-5339-4e59-a2f7-7406d9b98910 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:37.694695 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ace3-5339-4e59-a2f7-7406d9b98910 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:37.702708 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac4b8b-a264-4c6b-bbf1-29ae254f18ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:37.703484 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac4b8b-a264-4c6b-bbf1-29ae254f18ff admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.703807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac4b8b-a264-4c6b-bbf1-29ae254f18ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.704117 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac4b8b-a264-4c6b-bbf1-29ae254f18ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.704857 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac4b8b-a264-4c6b-bbf1-29ae254f18ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:37.706644 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac4b8b-a264-4c6b-bbf1-29ae254f18ff admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:37.720537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1463/2904] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:37.727389 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666823-7ac3-4af5-9ac3-af012a616cdb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:37.739870 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666823-7ac3-4af5-9ac3-af012a616cdb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:37.745204 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5891-147c-4027-a954-1e940e7d4e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:37.745861 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5891-147c-4027-a954-1e940e7d4e9f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.746133 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5891-147c-4027-a954-1e940e7d4e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.746402 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5891-147c-4027-a954-1e940e7d4e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.747289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e5891-147c-4027-a954-1e940e7d4e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:37.749154 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e5891-147c-4027-a954-1e940e7d4e9f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:37.761532 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1442/2905] 10.222.0.78 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:37.767374 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac4b8b-a264-4c6b-bbf1-29ae254f18ff admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:37.779057 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac4b8b-a264-4c6b-bbf1-29ae254f18ff admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:37.785406 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a8f9-6cc0-409a-aa82-ab771404fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:37.786099 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a8f9-6cc0-409a-aa82-ab771404fbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.786377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a8f9-6cc0-409a-aa82-ab771404fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.786684 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a8f9-6cc0-409a-aa82-ab771404fbe4 admin admin] PATH_INFO: `/v3/projects/fc44f6f437584c7eae3f4464ac1d4646/users/73f503559f4d4c3ea7a8c4b6bd431470/roles/23a0d2d1a0af4ab48d71d9bbf06057db` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.806414 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a8f9-6cc0-409a-aa82-ab771404fbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc44f6f437584c7eae3f4464ac1d4646, user_id=73f503559f4d4c3ea7a8c4b6bd431470, role_id=23a0d2d1a0af4ab48d71d9bbf06057db)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:37.809210 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a8f9-6cc0-409a-aa82-ab771404fbe4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:37.826869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1464/2906] 10.222.0.78 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:37 2022] PUT /identity/v3/projects/fc44f6f437584c7eae3f4464ac1d4646/users/73f503559f4d4c3ea7a8c4b6bd431470/roles/23a0d2d1a0af4ab48d71d9bbf06057db => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:44:37.898707 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990af8-8dfd-46a6-8a6c-a168ea3dbece None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.899110 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990af8-8dfd-46a6-8a6c-a168ea3dbece None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.899493 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990af8-8dfd-46a6-8a6c-a168ea3dbece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.934837 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-01990af8-8dfd-46a6-8a6c-a168ea3dbece None None] MFA Rules not processed for user `73f503559f4d4c3ea7a8c4b6bd431470`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:37.936405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-01990af8-8dfd-46a6-8a6c-a168ea3dbece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:37.946841 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:38.026624 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1443/2907] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:38.044560 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a8f9-6cc0-409a-aa82-ab771404fbe4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:38.046810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4cb3a8f9-6cc0-409a-aa82-ab771404fbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:38.144539 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a8f9-6cc0-409a-aa82-ab771404fbe4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:38.151115 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfeea2-a2f5-4d54-81d9-67f34f7ad3d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e736e983399140c2a7e6ee2c9e297021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:38.152193 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfeea2-a2f5-4d54-81d9-67f34f7ad3d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:38.152643 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfeea2-a2f5-4d54-81d9-67f34f7ad3d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:38.153088 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfeea2-a2f5-4d54-81d9-67f34f7ad3d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:38.171707 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfeea2-a2f5-4d54-81d9-67f34f7ad3d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:38.174581 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfeea2-a2f5-4d54-81d9-67f34f7ad3d1 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:38.194377 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1465/2908] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:44:43.710782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01990af8-8dfd-46a6-8a6c-a168ea3dbece None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:43.804549 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01990af8-8dfd-46a6-8a6c-a168ea3dbece None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:43.810487 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:43.811358 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:43.811768 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:43.812214 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] PATH_INFO: `/v3/users/73f503559f4d4c3ea7a8c4b6bd431470` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:43.813719 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f503559f4d4c3ea7a8c4b6bd431470)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:43.815951 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:43.894720 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f503559f4d4c3ea7a8c4b6bd431470'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:43.895888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f503559f4d4c3ea7a8c4b6bd431470'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:43.896844 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f503559f4d4c3ea7a8c4b6bd431470'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:43.917684 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f503559f4d4c3ea7a8c4b6bd431470'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:43.929637 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f503559f4d4c3ea7a8c4b6bd431470'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:43.948561 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1444/2909] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:43 2022] DELETE /identity/v3/users/73f503559f4d4c3ea7a8c4b6bd431470 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:43.953869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d673a6-5126-4c68-9fa4-5a7c669659e2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:43.954839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d673a6-5126-4c68-9fa4-5a7c669659e2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:43.954839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d673a6-5126-4c68-9fa4-5a7c669659e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:43.978764 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c7d673a6-5126-4c68-9fa4-5a7c669659e2 None None] MFA Rules not processed for user `4cd618c84674445b8b18062be3eac4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:43.980624 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c7d673a6-5126-4c68-9fa4-5a7c669659e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:44.081173 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1466/2910] 10.222.0.78 () {58 vars in 958 bytes} [Wed Aug 24 03:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:44.099060 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:44.101360 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:44.168010 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:44.213405 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6042-d1a2-4b70-9dd7-6e80f0f06028 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:44.219210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13423f78-ccf9-40e9-92b4-3ae89828a0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:44.220127 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13423f78-ccf9-40e9-92b4-3ae89828a0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:44.220605 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13423f78-ccf9-40e9-92b4-3ae89828a0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:44.221078 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13423f78-ccf9-40e9-92b4-3ae89828a0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:44.234583 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13423f78-ccf9-40e9-92b4-3ae89828a0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:44.236746 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13423f78-ccf9-40e9-92b4-3ae89828a0f8 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:44.252073 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1445/2911] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:44.710810 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d673a6-5126-4c68-9fa4-5a7c669659e2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:44.712872 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c7d673a6-5126-4c68-9fa4-5a7c669659e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:44.729215 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d673a6-5126-4c68-9fa4-5a7c669659e2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:44.735630 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:44.736261 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:44.736546 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:44.736837 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] PATH_INFO: `/v3/projects/fc44f6f437584c7eae3f4464ac1d4646` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:44.738134 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc44f6f437584c7eae3f4464ac1d4646)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:44.740122 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:44.779201 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:44.821091 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc44f6f437584c7eae3f4464ac1d4646', 'request_id': 'req-025beb6d-0daf-461c-8704-554b53191762'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:44.831798 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc44f6f437584c7eae3f4464ac1d4646', 'request_id': 'req-025beb6d-0daf-461c-8704-554b53191762'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:44.841768 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc44f6f437584c7eae3f4464ac1d4646', 'request_id': 'req-025beb6d-0daf-461c-8704-554b53191762'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:44.860150 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] The token cache is being invalidate because project fc44f6f437584c7eae3f4464ac1d4646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:44.860649 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:44.861828 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:44.864569 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1467/2912] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:44 2022] DELETE /identity/v3/projects/fc44f6f437584c7eae3f4464ac1d4646 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:54.244465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=13 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:54.852668 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:30.607610 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13423f78-ccf9-40e9-92b4-3ae89828a0f8 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:30.610213 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-13423f78-ccf9-40e9-92b4-3ae89828a0f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:30.717862 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13423f78-ccf9-40e9-92b4-3ae89828a0f8 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:30.812563 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:30.813289 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:30.813570 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:30.813860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:30.816299 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:30.832219 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:30.834025 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:30.847860 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1446/2913] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:40.841744 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=58 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:15.630114 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:15.631739 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:15.725777 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025beb6d-0daf-461c-8704-554b53191762 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:15.731053 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1e255-3954-4e7f-8baa-fe1576afa9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:15.731731 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1e255-3954-4e7f-8baa-fe1576afa9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:15.732039 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1e255-3954-4e7f-8baa-fe1576afa9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:15.732313 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1e255-3954-4e7f-8baa-fe1576afa9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:15.734493 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-35f1e255-3954-4e7f-8baa-fe1576afa9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:15.748264 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1e255-3954-4e7f-8baa-fe1576afa9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:15.749869 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1e255-3954-4e7f-8baa-fe1576afa9d9 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:15.762242 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1468/2914] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:15.910854 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:15.914003 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:15.930333 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0038c-70bf-4626-8837-a22030331f86 service placement] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:15.936199 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8229e-7090-4cf4-a8b3-95b6154d5dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:15.937210 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8229e-7090-4cf4-a8b3-95b6154d5dbf service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:15.937623 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8229e-7090-4cf4-a8b3-95b6154d5dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:15.938033 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8229e-7090-4cf4-a8b3-95b6154d5dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:15.940822 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fae8229e-7090-4cf4-a8b3-95b6154d5dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:15.955782 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8229e-7090-4cf4-a8b3-95b6154d5dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:15.957954 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8229e-7090-4cf4-a8b3-95b6154d5dbf service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:15.973970 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1447/2915] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:16.096633 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1e255-3954-4e7f-8baa-fe1576afa9d9 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:16.109699 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1e255-3954-4e7f-8baa-fe1576afa9d9 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:16.119839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f2e48-bd62-4b09-9739-9b6c0732af07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:16.120728 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f2e48-bd62-4b09-9739-9b6c0732af07 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.121289 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f2e48-bd62-4b09-9739-9b6c0732af07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.122008 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f2e48-bd62-4b09-9739-9b6c0732af07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.125270 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d51f2e48-bd62-4b09-9739-9b6c0732af07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:16.225349 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f2e48-bd62-4b09-9739-9b6c0732af07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:16.228489 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f2e48-bd62-4b09-9739-9b6c0732af07 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:16.250793 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1469/2916] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:25.967145 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=6 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:26.240124 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=60 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:31.325227 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8229e-7090-4cf4-a8b3-95b6154d5dbf service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.337902 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8229e-7090-4cf4-a8b3-95b6154d5dbf service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.343969 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.344695 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.345158 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.345613 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.348080 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:31.362499 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.364129 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.376054 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1448/2917] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:41.371051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=6 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:02.163135 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f2e48-bd62-4b09-9739-9b6c0732af07 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.176807 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f2e48-bd62-4b09-9739-9b6c0732af07 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.181961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f87d3-2b63-42a8-a5b1-97445f8866cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.182705 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f87d3-2b63-42a8-a5b1-97445f8866cb service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.183044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f87d3-2b63-42a8-a5b1-97445f8866cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.183386 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f87d3-2b63-42a8-a5b1-97445f8866cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.185518 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d81f87d3-2b63-42a8-a5b1-97445f8866cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.280976 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f87d3-2b63-42a8-a5b1-97445f8866cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.282473 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f87d3-2b63-42a8-a5b1-97445f8866cb service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.294044 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1470/2918] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:03.836192 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.838491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.870948 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7106-706b-4d0f-bbe4-6f76720783ea service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.881233 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd928f0-bdb4-48c9-b41e-5f8fe0b7856a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.882411 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd928f0-bdb4-48c9-b41e-5f8fe0b7856a service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.882962 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd928f0-bdb4-48c9-b41e-5f8fe0b7856a service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.883491 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd928f0-bdb4-48c9-b41e-5f8fe0b7856a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.886689 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cfd928f0-bdb4-48c9-b41e-5f8fe0b7856a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.909839 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd928f0-bdb4-48c9-b41e-5f8fe0b7856a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.913716 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd928f0-bdb4-48c9-b41e-5f8fe0b7856a service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.935271 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1449/2919] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:04.148917 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f87d3-2b63-42a8-a5b1-97445f8866cb service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.164299 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f87d3-2b63-42a8-a5b1-97445f8866cb service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.171012 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.172067 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.172571 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.173029 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.177754 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.207862 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.209817 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.225786 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1471/2920] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:05.523692 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd928f0-bdb4-48c9-b41e-5f8fe0b7856a service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.535527 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd928f0-bdb4-48c9-b41e-5f8fe0b7856a service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.539938 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1fb46-6566-4b55-ae18-fe564a4a09ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.540888 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fb46-6566-4b55-ae18-fe564a4a09ce service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.541353 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fb46-6566-4b55-ae18-fe564a4a09ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.541815 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fb46-6566-4b55-ae18-fe564a4a09ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.545295 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a6a1fb46-6566-4b55-ae18-fe564a4a09ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.573454 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1fb46-6566-4b55-ae18-fe564a4a09ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.576124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1fb46-6566-4b55-ae18-fe564a4a09ce service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.600926 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1450/2921] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:07.068537 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.070137 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.087495 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e3820-4fe1-41a7-9745-65ff4f2c7f3c service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.097055 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '438786dead414066a6ef101a2493fb8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.098142 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.098592 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.099153 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.103398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.139697 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.142682 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.168129 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1472/2922] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:08.447718 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1fb46-6566-4b55-ae18-fe564a4a09ce service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.458120 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1fb46-6566-4b55-ae18-fe564a4a09ce service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.472119 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7744-ab72-4dc1-a30a-abd1b7791bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e7bc56706f2491b92f5745a0fbc2acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.473278 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7744-ab72-4dc1-a30a-abd1b7791bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.473670 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7744-ab72-4dc1-a30a-abd1b7791bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.474035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7744-ab72-4dc1-a30a-abd1b7791bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.476600 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-688f7744-ab72-4dc1-a30a-abd1b7791bc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:08.609124 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7744-ab72-4dc1-a30a-abd1b7791bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.611876 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7744-ab72-4dc1-a30a-abd1b7791bc5 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.631576 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1451/2923] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:12.895530 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.898001 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:12.923103 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a3afc-7646-43a6-b776-2b4d7124fa4a service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.931882 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.932937 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.933469 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.933961 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.936666 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:12.953101 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.955253 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.983243 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1473/2924] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:17.328424 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7744-ab72-4dc1-a30a-abd1b7791bc5 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.350465 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7744-ab72-4dc1-a30a-abd1b7791bc5 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.361301 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3a4d3-b63b-4a0b-b7b0-81354757042d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.361941 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3a4d3-b63b-4a0b-b7b0-81354757042d service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.363953 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3a4d3-b63b-4a0b-b7b0-81354757042d service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.363953 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3a4d3-b63b-4a0b-b7b0-81354757042d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.365086 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2cf3a4d3-b63b-4a0b-b7b0-81354757042d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:17.380591 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3a4d3-b63b-4a0b-b7b0-81354757042d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.382429 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3a4d3-b63b-4a0b-b7b0-81354757042d service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.395513 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1452/2925] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:17.445075 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.446752 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:17.464789 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cd633-3141-4337-b47d-d3819c3f6613 service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.472211 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.473398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.473867 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.474362 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] PATH_INFO: `/v3/users/abda0f0b14fe4e5f8a8af0525c2e0e62` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.476734 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abda0f0b14fe4e5f8a8af0525c2e0e62)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.480727 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.561919 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abda0f0b14fe4e5f8a8af0525c2e0e62'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.562722 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abda0f0b14fe4e5f8a8af0525c2e0e62'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.580694 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abda0f0b14fe4e5f8a8af0525c2e0e62'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.591501 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abda0f0b14fe4e5f8a8af0525c2e0e62'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.601685 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abda0f0b14fe4e5f8a8af0525c2e0e62'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.609058 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1474/2926] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:17 2022] DELETE /identity/v3/users/abda0f0b14fe4e5f8a8af0525c2e0e62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:17.860169 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3a4d3-b63b-4a0b-b7b0-81354757042d service placement] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.875757 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3a4d3-b63b-4a0b-b7b0-81354757042d service placement] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.970123 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.971441 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.971717 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.972020 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] PATH_INFO: `/v3/projects/27a7ba12af984afda9b6d9ef80d4434f` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.973466 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a7ba12af984afda9b6d9ef80d4434f)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.975477 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.037980 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a7ba12af984afda9b6d9ef80d4434f', 'request_id': 'req-e5b2ce40-660a-4b10-8ac4-07ac385a807b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.046455 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a7ba12af984afda9b6d9ef80d4434f', 'request_id': 'req-e5b2ce40-660a-4b10-8ac4-07ac385a807b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.049385 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:18.056828 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a7ba12af984afda9b6d9ef80d4434f', 'request_id': 'req-e5b2ce40-660a-4b10-8ac4-07ac385a807b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.073339 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] The token cache is being invalidate because project 27a7ba12af984afda9b6d9ef80d4434f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:18.073682 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.074425 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.076057 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1453/2927] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:17 2022] DELETE /identity/v3/projects/27a7ba12af984afda9b6d9ef80d4434f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:18.081082 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.083007 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.098178 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec1fa3-f12d-4a2b-aa84-6b11db5f5c22 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.140199 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:18.186578 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.187268 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.187573 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.187842 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] PATH_INFO: `/v3/users/f366723cdbf94905a2b8cf3cb825effb` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.189265 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f366723cdbf94905a2b8cf3cb825effb)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.191832 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.272980 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f366723cdbf94905a2b8cf3cb825effb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.273818 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f366723cdbf94905a2b8cf3cb825effb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.289763 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f366723cdbf94905a2b8cf3cb825effb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.302407 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f366723cdbf94905a2b8cf3cb825effb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.316534 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f366723cdbf94905a2b8cf3cb825effb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.327365 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1475/2928] 10.222.0.78 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:18 2022] DELETE /identity/v3/users/f366723cdbf94905a2b8cf3cb825effb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:18.568958 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.571480 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.599035 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2ce40-660a-4b10-8ac4-07ac385a807b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.701602 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd618c84674445b8b18062be3eac4f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7911c9363a5f49a3b74eb85a8f08a450', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.703434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.703434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.703434 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] PATH_INFO: `/v3/projects/d288c60e0f0f4e629070ff205837a630` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.705354 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d288c60e0f0f4e629070ff205837a630)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.709388 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.783273 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd288c60e0f0f4e629070ff205837a630', 'request_id': 'req-f1769f46-01ed-4c6e-bf7c-178561fb93e6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.796051 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd288c60e0f0f4e629070ff205837a630', 'request_id': 'req-f1769f46-01ed-4c6e-bf7c-178561fb93e6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.818414 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd288c60e0f0f4e629070ff205837a630', 'request_id': 'req-f1769f46-01ed-4c6e-bf7c-178561fb93e6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.851628 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] The token cache is being invalidate because project d288c60e0f0f4e629070ff205837a630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:18.852109 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.853045 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f1769f46-01ed-4c6e-bf7c-178561fb93e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.854939 dv-cinder-854260-1-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1454/2929] 10.222.0.78 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:18 2022] DELETE /identity/v3/projects/d288c60e0f0f4e629070ff205837a630 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:28.321260 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:28.845101 dv-cinder-854260-1-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=55,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:35.609143 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:35.611398 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:35.808458 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b88eea-1214-408a-9577-6717eee4840d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:35.915918 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745119c-27de-4037-8f78-6b4b252f644e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496b8b8fa8ad4cc59b7f3d2c48cdd977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0093840f59cc4070b3dead79b27c25bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:35.916849 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745119c-27de-4037-8f78-6b4b252f644e service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:35.917350 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745119c-27de-4037-8f78-6b4b252f644e service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:35.917765 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745119c-27de-4037-8f78-6b4b252f644e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:35.920955 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8745119c-27de-4037-8f78-6b4b252f644e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:35.940614 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745119c-27de-4037-8f78-6b4b252f644e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:35.943839 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745119c-27de-4037-8f78-6b4b252f644e service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:35.959085 dv-cinder-854260-1-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1476/2930] 10.222.0.78 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:51:45.952276 dv-cinder-854260-1-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}